Implement pipeline recommendations

lsst-uk / sky-estimation-WP3.7

Repository for sky-subtraction routines to preserve LSB features, including tests with mock data

Apache License 2.0

2 stars 3 forks source link

Closed tms-epcc closed 3 months ago

tms-epcc commented 1 year ago

tms-epcc commented 1 year ago

20/JUL/23

tms-epcc commented 1 year ago

09/AUG/23

tms-epcc commented 12 months ago

31/AUG/23

Lee on vacation so no progress
will review the documentation from the metrics workshop and if continues to crash, will contact Lee

tms-epcc commented 10 months ago

04/OCT/23

tms-epcc commented 9 months ago

30/NOV/23

equates to 1st bullet in FY23 AE quarter plan for Oct to Dec '23
will finalise after Aaron's DM visit in Dec'23
now on batch processing so no longer takes 24 hours
visit will test output, verify impact on key science goals is tolerable
if yes, will ask DM to implement, if not, will require more discussion on how to proceed.

tms-epcc commented 7 months ago

18/JAN/24

discussed at Princeton with DM team
submitted recommendation and justification
ran full pipeline using the recommendations. Unfortunately, but not unsurprisingly, there are some items that appeared that need to be rectified.
if unable to make recommendations part of default pipeline then the plan is to instead branch the pipeline. The decision will depend on the timescales for when ComCam data starts arriving at then end of the year. Want this to be part of the commissioning. But decision will be made as late as possible since aim is to have a better product. This is expected to also be DM strategy.
Aim is to have solution of some kind by early 25

tms-epcc commented 6 months ago

07/FEB/24

Aaron looked at DM metrics and compared photometry metrics with default pipeline and the LSB recommended version
so far preliminary results are promising and indicate no impact.
Further metrics will be examined to further confirm this.
If yes, will propose DM.

tms-epcc commented 5 months ago

14/MAR/24

tms-epcc commented 4 months ago

11/APR/24

discussion with DM team
investigating why patch boundaries are seen on stitching even with default pipeline
Lee do not want to follow LSB team recommendation since it affects quality
Aaron has to investigate how to prevent artefacts appearing
Background match (the stretch goal) is one further option so Aaron will investigate further.
Aaron and Sugata will agree the way forward in the next few days
This iterative interaction with DM is as expected.

tms-epcc commented 3 months ago

02/MAY/24

tms-epcc commented 3 months ago

23/MAY/24

so this is being tracked in a separate ticket (#73) and the current ticket is closed