andrewxhill / MOL

The Map of Life
mol.colorado.edu/
19 stars 4 forks source link

Moving bulkloader files into their own directory #107

Closed gaurav closed 12 years ago

gaurav commented 13 years ago

I'd really like to see the bulkloader log and progress files written into their own directory; that'll keep the source directory a little cleaner and would make it easier to write those logs into a standard location (/var/log/bulkloader?) in the future. It looks like a pretty easy change, so I'll do it once I've cleared my outstanding issues.

gaurav commented 12 years ago

Done as of @b18ef7d6076d73! Log files are now written into the logs directory, and progress files into progress/. I notice that loader.yaml assumes that every directory in the mol-data directory is a data directory; I've left this behavior in, but I remove logs and progress right after loader.py scans path for directories. I'm not sure if that's the most elegant way to do it, but I think it's good enough to close this (please reopen this if you disagree!).