search

hortonworks / registry

Schema Registry
Apache License 2.0
15 stars 8 forks source link

Existing Kafka Topic Migration Tool #193

Open harshach opened 7 years ago

harshach commented 7 years ago

Most often users ends up writing json or some other format into a topic. If they want to migrate this data into Avro encoded format supported by registry they end up writing their own consumer/producer tool to do this. This issue aims to provide a tooling to make this easier for users.

satishd commented 7 years ago

@harshach KafkaAvroSerDesApp supports json to avro by taking records from a data file. Do we want to enhance that to take records from existing topics and push those into target topic with the required transformation from json(or any other format) to avro?

OneCricketeer commented 6 years ago

they end up writing their own consumer/producer tool to do this

KSQL can be used to do this fairly simply