silverton-io / buz

Serverless multi-protocol + multi-destination event collection system.
https://buz.dev/
Apache License 2.0
186 stars 21 forks source link

WIP add materialize webhook source as buz sink #585

Closed jubrad closed 6 months ago

jubrad commented 6 months ago

So far this is very much a WIP PR that was made in haste without testing, but could stand as a starting off point to integrating buz with Materialize's webhook sources. Webhook sources have some limitations, but ultimately should be a bit better/more performant than using Tables directly.

https://materialize.com/docs/ingest-data/webhook-quickstart/

I'm not sure how to handle the schema/db names, or if the way I'm doing MZ view/source creation makes sense in this context.

jakthom commented 6 months ago

👀