risingwavelabs / risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.
https://www.risingwave.com/slack
Apache License 2.0
6.75k stars 557 forks source link

test: better organize source test with different encodings #16931

Closed xxchan closed 2 weeks ago

xxchan commented 3 months ago

Currently test data looks like this:

image

Besides, there's actually another folder: src/connector/src/test_data

It's way too messy:

The result is that even experienced developers (@xiangjinwu) need to relearn the convention each time. However, we are still developing many connector features, and the difficulty of adding new tests will hinder development.

Some ideas for improvement:

xxchan commented 3 months ago

With https://github.com/risingwavelabs/risingwave/issues/17002, we can simply do more unit tests instead of e2e tests.

We can also develop web apps https://risingwave-labs.slack.com/archives/C03A2PSS8KU/p1717127312643039

We can also do fuzz tests