flatironinstitute / disBatch

Dynamic dispatch of a list of command-line tasks, locally or on a cluster. Supports retrying failed tasks, and adding/removing compute resources on-the-fly.
Apache License 2.0
39 stars 9 forks source link

Comments and some minor changes #2

Closed dylex closed 7 years ago

dylex commented 7 years ago

Added an optional command to #DISBATCH REPEAT, mainly to avoid the magic #DISBATCH REPEAT SPACER. It's tempting to move more of the parsing (specifically prefix/suffix) into Blender as well. Have not tested any of these changes.

dylex commented 7 years ago

Now that I've thought about it, I believe the Blender and Feeder functionality can be merged efficiently, which might simplify some code. I'll take a stab at it if that's alright.

dylex commented 7 years ago

Converted task parsing to a simple generator function. Made a bit more use of TaskInfo (arguably overloading it) in the process. Also removed stripping entirely to be consistent, as discussed.