splashblot / dronedb

Location Intelligence & Data Visualization tool
http://carto.com
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

Parallelism for resque #84

Closed ivanprado closed 6 years ago

ivanprado commented 6 years ago

At this moment Resque is running without any parallelism, just one process for all queues. That creates huge bottlenecks at production when uploading big rasters.

Implement some parallelism and monitoring using God.

ivanprado commented 6 years ago

See https://github.com/splashblot/dronedb/commit/3cb1bf51f4cae090d8b053dc82f5c705e958e0cd and https://github.com/splashblot/docker-dronedb/commit/1a768bcfc1a90f16d3f7aedce84d4989fccfc1f1 for the implementation details. Now queues are configured in the file /dronedb/config/resque.god

ivanprado commented 6 years ago

Running on production.