MLOps - set up and containerize mongodb replica set and producer of RabbitMQ for the streaming data pipeline

CAFECA-IO / KnowledgeManagement

Creating, Sharing, Using and Managing the knowledge and information of CAFECA

https://mermer.com.tw/knowledge-management

MIT License

0 stars 1 forks source link

Closed arealclimber closed 2 months ago

arealclimber commented 2 months ago

實作：為流資料管道設定和容器化 mongodb 副本集和 RabbitMQ 生產者

arealclimber commented 2 months ago

arealclimber commented 2 months ago

用 docker compose 運行服務，包含 MongoDB 跟 RabbitMQ，運行之後，每秒寫入 10 筆資料，可以透過 RabbitMQ web ui 看到待處理的 tasks 數量、內容跟每秒產生的新 tasks 數量

arealclimber commented 2 months ago

took 8 hrs in total done