Setup Docker Container

[joelansbro]

The task is to successfully setup Docker and expose its port to connect to a basic Flask route to test usage

The Container needs the following installed:

• Python 3.10
• Flask - micro web framework for REST API
• PySpark - multithreaded data processing
• Pandas - Data manipulation
• RabbitMQ - message broker
• Celery - task management framework asynchronous task queue + scheduling
• MongoDB for data storage of raw articles, and also reports

This includes the new installation of RabbitMQ and Celery. Here is the theory behind the setup (also found within Task Scheduling notes): HTTP POST /article -> Flask API -> Celery worker -> Add article to DB -> Celery Worker -> Aggregate Article for keywords to DB -> Celery worker -> Run ML on keywords -> Store Results in DB

Once you have completed the basic setup you will need to expose further ports, for outbound API connection, DB connection, and debugging connections. But that will be on a separate ticket.

[jagithub2]

I've made a simple Dockerfile but it's not great at the moment - I should look into Docker Compose