search

ushahidi / SwiftRiver-Core

SwiftRiver Core Applications
6 stars 3 forks source link

Callbackqueue dev #20

Closed ekala closed 11 years ago

ekala commented 11 years ago

This branch contains the changes @69mb made to the processing workflow in the filters-dev branch.

The changes introduce callback queues which are used for moving drops around the MQ until the metadata extraction (and subsequent application of filters) is complete before they are posted to the web application.

We therefore hit the API once; when posting drops that have undergone full metadata extraction. We also get to reduce the no. of writes to the master DB.

69mb commented 11 years ago

+1, add #21 and this is good to go...

Also remember the change in the web app to remove droplet_processed from the queries otherwise the drops will never be visible since droplet processed now can never be 255...

ekala commented 11 years ago

@69mb Thanks for adding back the instrumentation changes :+1:

So merge and then deploy when the web app changes are in?

69mb commented 11 years ago

Yeah