Pull the data in small chunks per countries + data providers.
Store the data in the DB: POI list.
Local setup with docker-compose: MongoDB + RabbitMQ.
Unit + integration test
Diff is very large, in a different scenario (with more time) I would prefer to split this PR into subtasks.
There is still an open TODO, which is the retry mechanism after a message is nack.
For manual testing:
curl -X GET http://localhost:3000/run
This server is intended to emulate a lambda function, where a cronjob sends a request to /run every x time.
The /health endpoint is up or Kubernetes checks.
It was developed with a minimal libraries config, no frameworks for the routing logic. Dependencies in prod:
Summary
Diff is very large, in a different scenario (with more time) I would prefer to split this PR into subtasks. There is still an open TODO, which is the retry mechanism after a message is
nack
.For manual testing:
This server is intended to emulate a lambda function, where a cronjob sends a request to
/run
every x time. The/health
endpoint is up or Kubernetes checks.It was developed with a minimal libraries config, no frameworks for the routing logic. Dependencies in prod:
closes #1