search

brimdata / zync

Kafka connector to sync Zed lakes to and from Kafka topics
BSD 3-Clause "New" or "Revised" License
18 stars 3 forks source link

logging for zync #21

Open mccanne opened 2 years ago

mccanne commented 2 years ago

We should think through and implement how zync should do logging and change the various printf's to log calls. This will be used from orchestration and automation so these logs will be useful events in operational logging systems.

philrz commented 2 years ago

Some details on specific things one user wanted to see implemented here:

Is it possible to add some log when new data is receive from kafka in continuous mode? Actually data from kafka is write to zed lake but in my Zync container console (docker) I see nothing. I want to see something like old zync : number of row receive, commit id... something to show me that zync is really running and processing.