kamu-data / kamu-cli

Next-generation decentralized data lakehouse and a multi-party stream processing network
https://kamu.dev
Other
300 stars 13 forks source link

Flows don't work under `kamu ui` command #836

Open sergiimk opened 2 weeks ago

sergiimk commented 2 weeks ago

Describe the bug

If you start the web interface via kamu ui command and try to update any dataset - you will see flows not progressing.

Steps To Reproduce

  1. Initialize a workspace, e.g. examples/covid
  2. Run kamu ui
  3. Open covid19.alberta.case-details dataset
  4. Hit Update data button

Current Behavior

Flow will just sit there in forever without making any progress, because kamu ui code doesn't enter neither flows nor tasks executor loops.

Expected Behavior

Flows and tasks work as in node deployment

kamu system info

0.201.0

Logs

No response

Anything else?

We have a major duplication of code between kamu ui and kamu system api-server. Because the latter is used more frequently for testing it is more feature-full than the former.

This ticket should unify the two code paths. The kamu ui command should reuse the bulk of api-server contributing only an additional route for static website data and the UI config, so that we no longer forget to update one of them.

Subtasks