Closed james-s-willis closed 1 year ago
From a conversation with James.
This PR has the following goals:
alpenhorn
has been previously accustomed to). To accomodate this a Task Queue was added, with a threadpool, whose tasks will then be processed.tests/lfs
contains a mock for lfs
.alpenhorn 1
, but have not been ported to alpenhorn 2
, yet (e.g. https://github.com/chime-experiment/alpenhorn/pull/19).task.py
contains the new Task logic. update.py
has been then factored out, and can now use add_task(TaskClass)
for every type of Task
type.
The build is currently red because some tests check for help output, and one Python package has been updated since the code was written, changing the output. It still needs to be decided whether to fix the version of the Python package or update the tests.
- To begin bringing over fixes that have been added to
alpenhorn 1
, but have not been ported toalpenhorn 2
Unless there's specific things needed to support the task queue, I would do this part in a separate PR.
Whilst the functional parts of James's work is still present, I've largely rewritten the task/queue framework.
I'll going to create a new PR for that.
@jrs65 @ketiltrout I've added the nearline test, so this is ready to review now