DLUT-LYZ / CODA-LM

Official PyTorch implementation of CODA-LM(https://arxiv.org/abs/2404.10595)
https://coda-dataset.github.io/coda-lm/
66 stars 2 forks source link

about evaluation #5

Closed Zoeeeing closed 4 months ago

Zoeeeing commented 4 months ago

Dear author, Thanks for your great work! Will the evaluation code be made available? We can use it for offline evaluation. Best

KaiChen1998 commented 4 months ago

@Zoeeeing Thank you for your interest in our CODA-LM! Although we cannot release the ground truth annotations of the CODA-LM Test set, we release the evaluation code for evaluation on the CODA-LM val set.

Moreover, CODA-LM is now utilized to hold the W-CODA challenge in ECCV 2024. Welcome to submit your results for our competition!