danthegoodman1 / icedb

An in-process Parquet merge engine for better data warehousing in S3
https://blog.danthegoodman.com/icedb-v3--third-times-the-charm
Other
125 stars 5 forks source link

Segment proxy/spoof example #84

Open danthegoodman1 opened 1 year ago

danthegoodman1 commented 1 year ago

Updated and terse example of https://github.com/danthegoodman1/IceDBSegment/tree/main

Where combined with either the cloudflare proxy (or this can do it as well) will ingest segment events directly without actually using segment, so you can use the segment package in all of the languages they offer.

Can optionally forward to segment (and thus be used as a proxy for segment on your own domain), but oprimarily it inserts events into icedb in tables of user_id,date and event_id,date partitions.

Hot-swap out segment, or just get the benefit of their packages.

danthegoodman1 commented 1 year ago

Related to #78

danthegoodman1 commented 1 year ago

See https://github.com/UltimateTournament/SegmentProxyIceDB/blob/main/src/index.ts