abrarmajeedi / rica2_aqa

Code release for RICA^2: Rubric-Informed, Calibrated Assessment of Actions (ECCV 2024)
MIT License
7 stars 0 forks source link

JIGSAWS evaluation #3

Open IsabelFunke opened 1 week ago

IsabelFunke commented 1 week ago

Hello,

Congratulations on this work, impressive results! I enjoyed reading the paper very much.

One question: Are you planning to release the code for the experiments on the JIGSAWS dataset? So far, I can only find folders for MTL-AQA and FineDiving.

Best wishes, Isabel

abrarmajeedi commented 1 day ago

Hi Isabel,

Thank you for your interest in our work. Given the complexity of JIGSAWS dataset evaluation (4 fold cross validation across three subtasks) most existing work (e.g. TPT, CoRe) does not release the experiment setup for JIGSAWS, so we were not planning to release the code for it, but given your interest, we will try to add support for JIGSAWS as soon as possible.

IsabelFunke commented 1 day ago

Sounds great, thanks!