D3.3.4 Targeting workflow software - Githubissues

lsst-uk / Spectro-Class-Transients

0 stars 0 forks source link

D3.3.4 Targeting workflow software #6

Closed tms-epcc closed 1 year ago

tms-epcc commented 3 years ago

The targeting workflow software to embed selected targets from Lasair into the 4MOST observing stream.

Deliverable type	Dissemination Level
Software	Public

tms-epcc commented 2 years ago

02/FEB/22

Work has started early on this due to ZTF downtime hence this has been to the Oct21-Mar22 plan
To progress this currently pretending already have Lasair targets and then working with 4MOST to make sure they know what to expect from Lasair

tms-epcc commented 2 years ago

27/APR/22

this will be the major focus from now since next deliverable

tms-epcc commented 2 years ago

From Apr-Jun'22 quarterly plan in Mar'22 update

Shift LSST:UK focus onto D3.3.4 - The development of communication with the 4MOST target OB upload interface. This deliverable forms the final component of targeting flow from LSST to the 4MOST observing queue.

tms-epcc commented 2 years ago

08/JUN/22

now have code from 4MOST to interface with their pipeline
attended Hamburg meeting with their lead developer
code tested, works in many cases but there are some issues to resolve

tms-epcc commented 2 years ago

27/JUL/22

have agreed that simulations from #28 will be used for testing purposes

tms-epcc commented 2 years ago

14/SEP/22 @chrisfrohmaier reported

started testing, found a bug and reported this to 4MOST software dev team deputy lead Jake Laas via their ticketing system
once bug fixed, will test again

tms-epcc commented 2 years ago

05/OCT/22

bug not yet fixed since not a priority for the dev person but this is not a problem
number of targets is sufficient already so no concerns about overloading their system.
will still test when bug fixed to confirm can handle LSST scale

tms-epcc commented 2 years ago

09/NOV/22

next update is 01/DEC/22 so expect to hear then about the bug fix.

tms-epcc commented 1 year ago

19/DEC/22

bug reported above now fixed
now tested API thoroughly using Python tools
all works except
- cannot delete objects (so submitted feature request)
- slow (ok for testing and closing the ticket aims but will be too slow for LSST scale)
so overall confident can meet the aims of the deliverable

tms-epcc commented 1 year ago

03/FEB/23

related to airflow task (see #37)
if necessary to complete the deliverable the existing pipeline bash script referred to in #37 will be used.

tms-epcc commented 1 year ago

24/FEB/23

@chrisfrohmaier and @msullivan318 happy to continue with previous WP3.3 reviewers.

tms-epcc commented 1 year ago

10/MAR/23

expect to have software ready by 31/MAR/23 with a minimal covering document.

tms-epcc commented 1 year ago

04/MAY/23 @chrisfrohmaier reported

The code is finished, tested, and works. Here is the link to the Github repo directory: https://github.com/lsst-uk/tidesInterface-WP3.3/tree/main/tidesCommunicate
Associated D3.3.4 report not yet finished due 4MOST assigning a task to be completed by 05/MAY/23 for the 4MOST Science Team meeting in Sussex)
D3.3.4 software will be demo'ed at 4MOST meeting on 09/MAY/23

@tms-epcc reported

change requested C070 drafted.
this is to move due date from 31/MAR/23 to 31/MAY/23

tms-epcc commented 1 year ago

25/MAY/23

change request C070 retracted
deliverable submitted for review on 05/MAY/23
deliverable sent out to reviewers on on 09/MAY/23

tms-epcc commented 1 year ago

15/JUN/23

first review report arrived 24/MAY/23. Available at https://lsst-uk.atlassian.net/wiki/spaces/LUSC/pages/3191078933/D3.3.4+LSST+to+4MOST+communication+bridge

tms-epcc commented 1 year ago

05/JUL/23

submitted to the Exec for approval via email.
Exec have until 20/JUL/23 to raise any objections.

tms-epcc commented 1 year ago

21/JUL/23

deliverable approved by the Exec Group via email

tms-epcc commented 1 year ago

24/JUL/23

updated deliverable published via LUSC wiki and July'23 Newsletter.