Resume work on the interface with the Lasair real-time alerts Kafka stream

[tms-epcc]

From March'22 quarterly update.

• Resume work on the interface with the Lasair real-time alerts Kafka stream now that ZTF has been repaired.

[tms-epcc]

• found some bugs in Lasair, posted to Github

[tms-epcc]

13/JUL/22

• @chrisfrohmaier reported, had received email from @genghisken explaining new Lasair is ported to new hardware. @genghisken provided details for accessing this.
• this work will also help in the Means of Verification of the Lasair 4 milestone MS25 for Lasair 4.0 (see dependency link above)

[tms-epcc]

27/JUL/22

• check the material sent by @genghisken
• can access real-time stream using the Lasair module in Python, now need to test this to its full extent

[tms-epcc]

17/AUG/22 @chrisfrohmaier reported

• will write back to Lasair team about MS25 verification
  • not ready yet to confirm MS25 passed.
  • remaining concern is that some historical data is not searchable even though it is present in the databases
  • this does not affect the real-time stream but is related. The summer student looking at all of ZTF is unable to search for early data.
• to close this ticket itself ie #27, requires @chrisfrohmaier to tidy up and put updated code in WP3.3 repo.

[tms-epcc]

14/SEP/22

• @chrisfrohmaier will email @genghisken about the Lasair MS25 verification check and concerns

[tms-epcc]

05/OCT/22

• @chrisfrohmaier and @genghisken discussed Lasair MS25 and confirmed all code is still working on Lasair V4.0.
• Code is running in background and collecting data. Still to check the real-time data analysis.

[tms-epcc]

20/OCT/22 @chrisfrohmaier reported

• need to check outputs. It may be some time before this happens since lower on the priority list
• will also need to contact @genghisken again since custom streams have stopped working on Lasair. This could be a quota issue since default streams are working. Will submit a github issue to Lasair

[tms-epcc]

09/NOV/22

• all working as expected

[tms-epcc]

01/DEC/22

• continuing to use on ongoing basis, it works with the automatic streams
• this can therefore be closed