dchackett / taxi

Lightweight portable workflow management system for MCMC applications
MIT License
3 stars 1 forks source link

Store work dir for task to locate output files for rollback #33

Open dchackett opened 6 years ago

dchackett commented 6 years ago

Currently, Runner subclasses keep track of whatever output files they wrote in the attribute output_files, which is stored in the JSON payload of the DB. This is necessary because of awkwardness involving relative paths and finding the directory a taxi is working in. This scheme is fragile and a little graceless. Instead, after completing a task, have the taxi store the working directory a task was executed in in the dispatch DB. This should probably be a new column in the task table, but could be part of the JSON payload at first.