search

lsst-epo / citizen-science-notebooks

A collection Jupyter notebooks that can be used to associate Rubin Science Platform data to a Zooniverse citizen science project.
3 stars 1 forks source link

Continued citSci pipeline performance testing (trying deepCoadd.image, del deepCoadd, etc.) #96

Closed ericdrosas87 closed 4 months ago

ericdrosas87 commented 5 months ago

User story

As the architect of the citSci pipeline, I need to continue performance testing with the suggestions that came from the SQuaRE team to see if we get performance improvements from them.

Definition of done

I have tried out directly referencing the image field in the deepCoadd, and explicitly freed up memory after each iteration of the butler loop.

ericdrosas87 commented 5 months ago

Image

ericdrosas87 commented 5 months ago

Per MG: The new Image Cutout Service image query functionality has been released can be reviewed in tutorial notebook 13a. I'll be testing this query functionality out as well after I implement the concurrent query functionality.

ericdrosas87 commented 4 months ago

The main hold-up now is waiting for https://rubinobs.atlassian.net/browse/DM-43682 to be tested and merged/deployed to the Notebook Aspect environment by the SQuaRE team.