search

QutEcoacoustics / baw-workers

Workers that can process various long-running or intensive tasks.
Apache License 2.0
3 stars 0 forks source link

System level analysis runner #16

Closed atruskie closed 9 years ago

atruskie commented 9 years ago

We have the concept of an analysis runner that runs tasks for the website. E.g. false color index visualization for the website. The false color indices for the site represent a kind of mass analysis. Their output needs to be stored in a fashion that is not the same as an ordinary analysis task.

NOTE: this is not a custom/user/analysis jobs scenario.

We have to run the false-color generation over all of our website files.

We currently have a more general analysis worker. It contains a lot of good logic but for our system level analysis runner, some of that logic needs to be overridden / customised.

Current plan is to sub-class the current analysis runner and hardcode / customise the following:

Note these changes only affect the enqueue portions of the code.

Ideally the dequeuer (the part of the code that actually executed jobs) will remain the same.

atruskie commented 9 years ago

Related to: #14, #13

atruskie commented 9 years ago

This issue will make use of the changes in #20 / afc4cfdebb50fec44fe7165e547bbb8a64030dde