search

JasperSnoek / spearmint

Spearmint is a package to perform Bayesian optimization according to the algorithms outlined in the paper: Practical Bayesian Optimization of Machine Learning Algorithms. Jasper Snoek, Hugo Larochelle and Ryan P. Adams. Advances in Neural Information Processing Systems, 2012
http://people.seas.harvard.edu/~jsnoek/software.html
1.39k stars 335 forks source link

drmaa used for monitoring but not submitting jobs #30

Open cancan101 opened 10 years ago

cancan101 commented 10 years ago

In the SGE driver, drmaa is used by is_proc_alive but not submit_job.

Why is that?

JasperSnoek commented 10 years ago

Simply because it was straightforward to write a small amount of code that submitted jobs on sun grid engine with all the output redirects, etc. using python's subprocess library. However, checking the status of jobs on SGE turned out to be quite tricky (failed jobs, successful jobs, etc.) without drmaa (I would've preferred to not have that dependency).