Job logging - Githubissues

phockett / epsman

Management tools for ePolyScat job generation & execution.

1 stars 2 forks source link

Open phockett opened 4 years ago

phockett commented 4 years ago

Currently set in .json file per job and batch (directory).

Plan to process these globally and put in a DB for better job tracking.

phockett commented 4 years ago

Also: fix file naming scheme to avoid overwrite on rerunning jobs for additional E points (or add to existing log file).

phockett commented 3 years ago

To consider:

with JSON/NoSQL route, should also push out consolidated data to DB (or, at least, small files that can be referenced/pulled from Zenodo to another website).
DB for running jobs, as well as for processed jobs (currently only the latter).
MongoDb for implementation?
Django for web front-end (for ePSdata)?