Refactor everything
Change configuration format (breaking)
Added SQS provider
Add support for listeners/producers
Add support for multiple sources
Add support for multiple workers/pipes
Add minimal e2e test
Add usage documentation and project scope
Add support for multiple config files, dirs, command-line args and env variables
Need to add:
[ ] Observability (logs, metrics, tracing(?))
[x] Implement Error handling
[x] Stabilize Docker and tests
[x] Extract some generic utils
[ ] Wrap generic consumer/producer with better defaults
[ ] Marshal configuration with normal golang objects
[x] Output in pipe
[ ] Unit tests
[x] Set CI
Investigate:
CloudEvents integration
Partition support (for reading with streams like Kafka)
Refactor everything Change configuration format (breaking) Added SQS provider Add support for listeners/producers Add support for multiple sources Add support for multiple workers/pipes Add minimal e2e test Add usage documentation and project scope Add support for multiple config files, dirs, command-line args and env variables
Need to add:
Investigate: