D3.1.4 Build aggregation tools

[tms-epcc]

(D3.1.4, May 2024) Build appropriate aggregation tools, providing consensus from classifications provided by multiple volunteers

[tms-epcc]

03/AUG/24

• Chris reported that necessary aggregations tools have been created.
• Next step is to produce an accompanying report
• Expect to do this report in early 2024

[tms-epcc]

25/AUG/23 @chrislintott reported

• ongoing discussions with the EPO team regarding the extent to which this deliverable may already have been done

[tms-epcc]

19/JAN/24 @chrislintott reported in https://docs.google.com/document/d/13mgVp2T9EWWeuTVkvrf_WEW-xG721zaSsmiCrAdWHwo/edit that FY24 plan includes

1. Batch aggregation (D 3.1.4) - provide API endpoints and tools for more sophisticated handling of aggregation, so that it can run on particular subjects or subject sets, and on a programmatic or scheduled basis. Aggregation could also be trigged via the Python client or notebook so data can be returned to RSP. Development underway: target date end Feb.

[tms-epcc]

26/JAN/24

• @chrislintott explained the need for these batch aggregation tools arose out of the Lasair trial project #2

[tms-epcc]

27/MAR/24 @chrislintott reported that good progress is being made on this and currently sees no issues with the 31/MAY/24 due date.

[tms-epcc]

24/APR/24 @chrislintott reported

• Some components have already been implemented and are being reviewed
• still expect delivery to meet due date as planned

[tms-epcc]

29/MAY/24

• as reported in FY24 Q2 QU

  The existing Aggregations code (zooniverse/aggregation-for-caesar repo) offers an offline / local solution for processing classifications and producing subject-specific summary results - greatly simplifying the post-processing required by Zooniverse project teams, but this can only be run once data has been downloaded. Instead, we want the code to run in response to a button push or API call, over a batch of recent classifications, facilitating the transfer of aggregated data back to the science platform. This required a new Zooniverse-hosted application endpoint to accept and process requests for aggregation of classification batches, which executes data ingest, extraction, reduction, and output data bundle creation. For now, the example implementation will be for binary workflows, but this could quickly be expanded. Progress has been good, with job management implemented https://github.com/zooniverse/aggregation-for-caesar/pull/783) and the individual pieces of functionality ready to add to Panoptes, the Zooniverse backend (https://github.com/zooniverse/panoptes/pull/4303). Integrating these components will be the first task next quarter. We also completed testing of the project copier functionality, including small bug fixes (e.g. https://github.com/zooniverse/panoptes/pull/4270)