search

ConservationMetrics / mapgl-tile-renderer

Headless Node.js Maplibre-GL renderer for generating MBTiles with styled raster tiles.
MIT License
6 stars 3 forks source link

Implement a FOSS & offline-first message broker to queue tasks #28

Open rudokemper opened 4 months ago

rudokemper commented 4 months ago

Feature Request

Right now, mapgl-tile-renderer is set up to work with Azure Storage Queue as a message broker to receive tasks to generate offline maps in the background, and send a message back to remove that task from the queue once completed.

Let's provide an open-source alternative so we are not exclusively tied to Azure. One possibility is to use RabbitMQ.

rudokemper commented 1 month ago

Alternatively, we can consider taking this approach of co-locating the task queue in the database directly, which would eliminate the need for a FOSS / offline-first message broker. Cf. https://github.com/ConservationMetrics/mapgl-tile-renderer/issues/50 for more discussion.

IamJeffG commented 1 month ago

I have used the in-DB approach in other systems. It works great and I highly recommend it for the simplicity. Introducing a different system (e.g. RabbitMQ) is prob worth it only if you have enormous volume of messages going across.