search

lsst-epo / citizen-science-notebooks

A collection Jupyter notebooks that can be used to associate Rubin Science Platform data to a Zooniverse citizen science project.
3 stars 1 forks source link

Implement `concurrent.futures` multiprocessing in `utils.py` as part of the `butler.get()` query #94

Open ericdrosas87 opened 5 months ago

ericdrosas87 commented 5 months ago

User story

As the developer of the citizen science pipeline and technical support infrastructure, I need to implement multiprocessing via concurrent.futures in order to speed up the Butler query time such that the 01 notebook is performant.

Definition of done

I have implemented concurrent.futures multiprocessing with the Butler queries.

ericdrosas87 commented 4 months ago

This is currently on hold as I await for the SQuaRE team to merge/deploy https://rubinobs.atlassian.net/browse/DM-43682 into Notebook Aspect.