brimdata / zync

Kafka connector to sync Zed lakes to and from Kafka topics
BSD 3-Clause "New" or "Revised" License
17 stars 3 forks source link

Allow org.apache names in Connect JSON schema #123

Closed nwt closed 3 months ago

nwt commented 3 months ago

connectjson.Decoder deliberately panics if it encounters a schema element whose name begins with org.apache. Remove that behavior so org.apache names are allowed.

(The panic is left over from development of the connectjson package, when it wasn't clear whether to interpret values according to schema element names during decoding. For example, a value whose corresponding schema element has type int64 and name org.apache.kafka.connect.data.Timestamp could be interpreted either as a simple int64 or, per the name, as a time in milliseconds since the Unix epoch. The connectjson package takes the former approach, mostly because the current decoding process offers no easy way to perform the necessary scaling.)