Unstructured-IO / unstructured-ingest

Apache License 2.0
20 stars 19 forks source link

fix/Kafka cloud source couldn't connect, add test #257

Open hubert-rutkowski85 opened 4 days ago

hubert-rutkowski85 commented 4 days ago

Couple of things here:

  1. There were 2 config errors in the Kafka Cloud source connector.

  2. Also added integration test for it. To have it work, admin will have to set secrets KAFKA_API_KEY , KAFKA_SECRET and KAFKA_BOOTSTRAP_SERVER in repo.

  3. Kafka source connector has new field: group_id

  4. Make the auth fields be mandatory.