E2E: add coverage for Flow and Task system

kamu-data / kamu-cli

Next-generation decentralized data lakehouse and a multi-party stream processing network

https://kamu.dev

Other

299 stars 13 forks source link

E2E: add coverage for Flow and Task system #817

Open zaychenko-sergei opened 3 weeks ago

zaychenko-sergei commented 3 weeks ago

The test(s) should cover:

[x] Creating root & derived datasets (using predefined files)
[ ] Defining flow configurations for updates and observing the triggers
[x] Triggering flows manually
[ ] Compacting & resetting flows

Currently, our E2E testing is based on low-level exchange of messages via GraphQL API. Try prototyping higher level test steps that setup the fixture, apply actions and observe results from user point of view.

s373r commented 2 days ago

Within https://github.com/kamu-data/kamu-cli/pull/863, several E2E tests have been added that cover part of the expectations of this ticket:

Creating root & derived datasets (using predefined files)
Triggering flows manually