search

flatironinstitute / disBatch

Dynamic dispatch of a list of command-line tasks, locally or on a cluster. Supports retrying failed tasks, and adding/removing compute resources on-the-fly.
Apache License 2.0
39 stars 9 forks source link

Update packaging #32

Closed lgarrison closed 4 hours ago

lgarrison commented 1 week ago

Inspired by recent problems finding dbUtil.sh when installing disBatch, we'd like to update the packaging so everything gets installed where it should. This is also a chance to remove any dependency on PYTHONPATH being set to a particular value. Let's also put disBatch on PyPI!

disBatch is also a good candidate for use with pipx or uvx, so let's set up the right hooks for that. This should give users the option of running disBatch as a standalone tool, i.e. without a venv. In the case of uvx, it's not even required that the user has Python installed, as that will be bootstrapped.

lgarrison commented 6 days ago

@njcarriero Any comments are welcome! The changes in this PR are summarized in CHANGES.md.

lgarrison commented 4 hours ago

Nick and I iterated offline and improved some of the formatting and documentation; now ready to merge.