RFC: System Architecture

[mf4dl1]

General Overview

Requirement

• We need to create Desktop Based software whichis in the form of InaSAFE DaLA feature and web based software, in the form of Django
• Both of those interface, shall runs the same CORE classes

[jj0hns0n]

Lets consider to use a message queue to control the AUTO jobs in the Web Based Interface. Look at how InaSAFE realtime is handling this. Perhaps use http://www.celeryproject.org/ @timlinux can you shed some insight on your methodology.

[timlinux]

We currently arent using celery / a message queue in realtime since the quake reports are generated using a separate service in and pushed over to the realtime site in the new architecture (and generated as static pages in the old).

We are using celery in other projects - you can see an example here if you are interested:

https://github.com/kartoza/watchkeeper

And I would be happy to adapt InaSAFE realtime to use celery where needed.

[jj0hns0n]

@timlinux are you just using a database queue or something like rabbitmq?

[timlinux]

For current realtime implementation we have:

• A cron job that checks each minute for new shakemaps
• Cron kicks off a dockerised CLI app that generates the new shakemap if found and adds it to a public dir
• Apache with some .htaccess magic serving up s simple file listing styled up a bit with bootstrap

Its very simple but pretty bullet proof

In the new architecture we are working on right now we will have:

• same architecture above except when shakemap is done, it pushes a notification via rest api to the realtime django site
• realtime will provide a more jazzed up view ov events with filters by mmi / date / spatial bbox + a map view of event locations

In the future we plan to extend the system to do more hazard types and we will most likely provide for a mix of approaches, so if you want to you can write an app for the django project that listens for events e.g. from a GeoRSS feed and then triggers a process request on an event queue.

@lucernae is the developer working on current implementation for realtime, so feel free to chip in here Rizky