search

silverton-io / buz

Serverless multi-protocol + multi-destination event collection system.
https://buz.dev/
Apache License 2.0
186 stars 21 forks source link

Snowplow payload schema registry #571

Open hakanuzum opened 11 months ago

hakanuzum commented 11 months ago

I am sending Snowplow payload data to Postgres, but the payload is in jsonb format. Am I missing something in the documentation? Isn't there a solution to print the payload in raw form?

image

leonard-henriquez commented 10 months ago

Did you find an answer @hakanuzum ?

hakanuzum commented 8 months ago

Did you find an answer @hakanuzum ?

Hi Leonard, Unfortunately, I haven't found an answer or alternative result yet. If you can reach me, please let me know :)

jakthom commented 6 months ago

Hey @hakanuzum , what do you mean by "print payload in raw form"?

The payload landing in postgres as jsonb is expected, but if you can also write payloads to stdout, or a local file, etc.

hakanuzum commented 5 months ago

hi @jakthom

What I actually wanted to talk about was how to send the incoming data in the form of rows and columns instead of sending it to the database as raw json. Is it necessary to edit this on the redpanda side. I could not find how to do it in the documentation and my research. This problem may not be a problem directly related to the product itself. The main issue is that the snowplow payload sent to the database is parse and sent in rows and columns. I don't want to write raw json.

If there is a sample document or link, it would be super.