caporaso-lab-graveyard / clout

A tool for the automated testing of software using cloud-based services.
http://qiime.org/clout
GNU General Public License v2.0
3 stars 3 forks source link

Warn if files are being left behind by tests #14

Open gregcaporaso opened 11 years ago

gregcaporaso commented 11 years ago

It would be useful if Clout could raise a warning of some type if tests are leaving files behind. This is useful when running tools like QIIME on a cluster. If runs of the test suite leave files with different names (e.g., randomly generated filenames) behind, those can build up to use a lot of disk space over many runs.

jairideout commented 11 years ago

Good idea- it would also be nice to see if processes are being left behind (e.g. in QIIME, poller.py can hang).

gregcaporaso commented 11 years ago

Agreed.

jairideout commented 11 years ago

Was looking into this a bit. This thread has some interesting ideas. We could look for files that were modified/created since the test suite started running, or could make a list of all files on the system before running the tests and do a diff with the list of files afterwards.

Does anyone have additional ideas for how to tackle this? I'm also interested in catching processes that are being left behind.