aiddata / monte-carlo-rasters

generate rasters based on monte carlo simulations
0 stars 0 forks source link

Queue system #10

Open sgoodm opened 9 years ago

sgoodm commented 9 years ago

Run requests are submitted to central directory as JSON files which holds detailed options (filters, etc.)

bash script scans queue directory, creates jobscripts and submits them

sgoodm commented 9 years ago

will require slight rework of how runscript takes input. can either fully convert to using JSON files for options or add a flag to jobscripts which determines whether to use JSON options or normal input arguments

could add priority system to make quick admin jobs easier (probably should add at least a basic priority system either way)

sgoodm commented 9 years ago

possible file structure for queue. mirrors initial output file structure for json data which will be loaded into mongodb