search

simonsobs / librarian

The HERA Librarian.
BSD 2-Clause "Simplified" License
1 stars 2 forks source link

Add Send Queue for background tasks. #69

Closed JBorrow closed 3 months ago

JBorrow commented 4 months ago

Add a background task scheduling mechanism for batched syncronous and asyncronous transfers.

JBorrow commented 4 months ago

Thanks! Yes, apologies that there isn't a proper set of docs here describing the workflow. I'm working on that in parallel, but given the 'unique' development requirements for the librarian, I de-prioritised that.

Regarding your comment about generated files... Do you mean the alembic migrations? Those are not auto-generated, I write them. They just have those filenames because they are tagged revisions.

iparask commented 3 months ago

Regarding your comment about generated files... Do you mean the alembic migrations? Those are not auto-generated, I write them. They just have those filenames because they are tagged revisions.

Yes, I mean the alembic migrations. I pointed it out because they have a creation timestamp in the comments and a revision number in the filename.

After looking in the repo a bit I saw that it is inherited from the previous versions of Librarian. You may want to rename them to something later and keep only the human-readable part on the file name and the revision number in the comments as it is already.