brimdata / zync

Kafka connector to sync Zed lakes to and from Kafka topics
BSD 3-Clause "New" or "Revised" License
18 stars 3 forks source link

Update to point to brimsec/zq and v0.5.0 tag #10

Closed philrz closed 4 years ago

philrz commented 4 years ago

There was a post recently on the Zeek mailing list that referenced Avro, which led us to consider chiming in to mention the applicability of zinger. However, zinger hasn't been touched in a while, so @mccanne made the valid point that it it should be updated to point to a recent zq and make sure the demo workflow still works correctly.

With help from @aswan, in this branch we've now got:

@aswan got it working well enough to handle all the Zeek types, though there's still some ZNG-only types it doesn't cover. Since we're only claiming prototype quality and our primary motivation right now is to have it ready for Zeek users to tinker with it, I've added a bullet to the caveats list. Once this is merged, I can open a reminder issue for us to circle back and catch up to full ZNG compatibility at a later date.