LSSTDESC / SprintWeek2020

Meeting repository for the LSST DESC 2020 Sprint Week

Apache License 2.0

2 stars 0 forks source link

[SPRINT] Disagreement matrix for the PLAsTiCC results paper #72

Open kponder opened 3 years ago

kponder commented 3 years ago

Disagreement matrix for the PLAsTiCC results paper

Creating a plot that illustrates how the top ~15 participants differed in classifications.

Contacts: @kponder @reneehlozek @mi-dai @MichelleLochner Day/Time: Tuesday. First call at 10 am EST Main communication channel: plasticc-public GitHub repo: https://github.com/aimalz/proclam

Goals and deliverable

Create this final plot for the results paper

Resources and skills needed

python

Detailed description

We need to download all of the csv entries for the top participants to make these plots

kponder commented 3 years ago

Please respond with appropriate emoji for day to work on this plot:

👍 for Tuesday 👎 for Wednesday ❤️ for Thursday 😄 for Friday

kponder commented 3 years ago

Quick call to discuss tasks at 10 am EST on Tuesday.

I reserved DESC 18 zoom room.

kponder commented 3 years ago

A subset of us will be working on this synchronously starting at 3 pm EST in DESC zoom room 18 .

kponder commented 3 years ago

Progress on creating possible plots can be seen here:

https://github.com/aimalz/proclam/blob/issue/93/visualization/results_paper/disagreement.ipynb

We worked on implementing a few different metrics to characterize the difference between classifiers. We are still brainstorming what the final "disagreement matrix" will look like; however, we do have a few ideas to look into.

kponder commented 3 years ago

We will be planning another sprint session later in the week.