Compare transients identified by ZTF with what WP3.3 want

tms-epcc commented 2 years ago

this is related to D3.3.3
it is concerned with reliably picking out transients

tms-epcc commented 2 years ago

Investigating Lasair streams

tms-epcc commented 2 years ago

ZTF went down for few days due to a cryo-cooler issue. Have some scripts but no results. Supernovae can be found but nothing quantitative done with that information

tms-epcc commented 2 years ago

ZTF has been down since early December.
Currently it appears that ZTF itself is being tested, but as yet data is not being distributed to Lasair.
Whilst scripts have been written by WP3.3 to find transients, these cannot be tested in real-time due to ZTF not yet distributing data to Lasair.
These WP3.3 scripts have though been tested successfully on existing data.

tms-epcc commented 2 years ago

02/FEB/22

Given the recent announcement that there will be further ZTF down-time, the intention now is look at using archive data to mock up a real-time stream. This will then be used for testing.

tms-epcc commented 2 years ago

16/MAR/22

created a mock stream for few objects. Now developing code with these as test subjects.
when ZTF come back, will then test the code on the real-time stream

tms-epcc commented 2 years ago

27/APR/22

ZTF back so code will be tested on real-time stream

tms-epcc commented 2 years ago

18/MAY/22

will require interface work now that ZTF is back and test in real-time

tms-epcc commented 2 years ago

14/SEP/22

other tasks have taken priority hence no progress

tms-epcc commented 1 year ago

05/OCT/22

now running in background as per #27

tms-epcc commented 1 year ago

09/NOV/22

running, but cannot yet be closed.

tms-epcc commented 1 year ago

01/DECC/22 @chrisfrohmaier reported

this works but in testing on large scale reached API quota on the web page
expect to close this soon once quota released

tms-epcc commented 1 year ago

19/DEC/22

API quota (Transient Name Server) is far too restrictive so need to change strategy and find different solution
Expect Lasair will have most of the information required so expect solution will use that instead.

tms-epcc commented 1 year ago

@chrisfrohmaier reported

no progress.
Solution implemented but still needs to be verified
This is a low priority task for the moment

tms-epcc commented 1 year ago

03/FEB/23

this is finished
code is now more efficient
@chrisfrohmaier will provide link to pdf or similar showing the results

tms-epcc commented 1 year ago

24/FEB/23

@chrisfrohmaier will provide link to pdf or similar showing the results
this can then be closed.

tms-epcc commented 1 year ago

10/MAR/23

@chrisfrohmaier to provide link to pdf or similar showing the results
this can then be closed.

chrisfrohmaier commented 1 year ago

Examples of Notebooks comparing the objects found by the TiDES Lasair query to the TNS objects. It shows that objects classified by TNS were found by the Laser query, and that their light curves were run through D3.3.3.

https://app.zenhub.com/files/343510431/d6d451d5-6211-4458-8d73-d7e301a2a931/download

https://app.zenhub.com/files/343510431/87532033-cbdd-4b47-818b-6b7d01314c07/download

lsst-uk / Spectro-Class-Transients

Compare transients identified by ZTF with what WP3.3 want #20