Investigate Kafka for python

[IronicUsername]

Goal Know if kafka is the way to go, to stream data from a db table.

Context As mentioned in high level issue #1 we want to have a constant stream of the most recent item in the TrashTvArchillectHistory table. Ideally we dont query the table every N seconds, but get the newest entry on table change. From a small discussion with @erayozer17 he mentioned kafka is what i would need for this. He added that it might be an overkill which might be correct.

In this issue we want to investigate how to go about streaming the most recent item in TrashTvArchillectHistory.

Tasks

• [ ] check if there is a tutorial for kafka X python (ideally also with fastapi as a websocket)
  • [ ] maybe dis?
  • [ ] or dis?
  • [ ] research on your own
• [ ] check alternatives if kafka is not the way to go
  • [ ] like Faust maybe?
  • [ ] come up with other competitors
• [ ] discuss in comments

[IronicUsername]

seems like Kafka is a big overkill for this project. Maybe we should use postgres's NOTIFY...

Idk ho this plays into staying db agnostic..