jitsucom / jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days
https://jitsu.com
MIT License
4.04k stars 287 forks source link

Feature request: Nested custom properties #1094

Closed gordonkjlee closed 5 months ago

gordonkjlee commented 6 months ago

Summary

When multiple events are written to a single events table in the database, there are many sparse columns if events have different custom properties. One way to work more flexibly would be to write to a single JSON object/field that contains multiple properties.

System configuration and versions

NA

Artifacts (logs, etc)

NA

vklimontovich commented 6 months ago

We actully have a feature called type hints. Within the function, it's possible to tell how to treat a certain fields in the incoming ojects. Among other things, it's possible to tell Jitsu not to flatten certain fields and store it as JSON object.

We don't have documentation for it yet, but we will add it soon

github-actions[bot] commented 6 months ago

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] commented 5 months ago

This issue was closed because it has been inactive for 14 days since being marked as stale.