search

riga / law

Build large-scale task workflows: luigi + job submission + remote targets + environment sandboxing using Docker/Singularity
http://law.readthedocs.io
BSD 3-Clause "New" or "Revised" License
98 stars 41 forks source link

Refactor job argument handling #97

Closed riga closed 4 years ago

riga commented 4 years ago

This PR changes two aspects regarding the interaction with jobs:

  1. Remote workflows had to implement their own submit_jobs() method, but they were all very similar. A generic method is now provided directly by the RemoteWorkflowProxy base class.

  2. Except for submission, no (keyword) arguments were passed to methods of JobManager implementations such as cancel() and query(). Now, there is a way to define kwargs to pass to those methods directly on task level.