Closed ed-ortizm closed 2 years ago
There is the ddf column in metadata. the ddf variable is "A Boolean flag to identify the object as coming from the DDF survey area (with value ddf = 1 for the DDF). Note that while the DDF fields are contained within the full WFD survey area, the DDF fields have significantly smaller uncertainties, given that the data are provided as additions of all observations in a given night. "
This is an importan variable since we already notice that the Wasserstein and Bottleneck distances have a strong dependence on noise.
There is also the variable detected: " detected: If detected= 1, the object’s brightness is significantly different at the 3 level relative to the reference template. This is given as a Boolean flag. "
Add following classes to the train data set
The anomaly detection is done on agn light curves from a different data set. What is pending from this issue is no longer required in the mean time.
Describe plasticc data and some of the processing prior to TDA. For instance, so far we have normalized by the mean to compare anomalies. We are also testing what happens if we keep negative fluxes or set them to zero. An intro to plasticc data can be found here: https://github.com/LSSTDESC/plasticc-kit/blob/master/plasticc_astro_starter_kit.ipynb https://github.com/LSSTDESC/plasticc-kit/blob/master/plasticc_classification_demo.ipynb