vmware-archive / sql-to-dbsp-compiler

Compiler translating SQL view definitions into DBSP circuits (https://github.com/vmware/database-stream-processor)
Other
28 stars 4 forks source link

There is no documentation on how to run the sql compiler #124

Open mihaibudiu opened 1 year ago

mihaibudiu commented 1 year ago

We need a small "hello world" example which

  1. creates a SQL script
  2. sends it to the compiler
  3. generates rust
  4. have a tester function in Rust that calls the generated circuit
  5. feed the circuit some change, get the output change and print it
ryzhyk commented 1 year ago

This works by starting a DBSP server and using the REST API for steps 2 and 3 and then feeding data to input endpoints. We don't have another way to do this kind of end-to-end testing available to the user.

mihaibudiu commented 1 year ago

They should be able to run this test without a web server. Just local files and a Rust compiler + our SQL compiler.

ryzhyk commented 1 year ago

I'm not sure who are the users this will be serving. Why not continue investing the effort in making the end-to-end API-based workflow easy to use?