search

codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0
Apache License 2.0
76 stars 28 forks source link

Mutiple leaderboard #1534

Closed hpc100 closed 4 months ago

hpc100 commented 4 months ago

Hello thank's for your work.

I want to create a competition for a dataset with 3 variant named A, B, C. I'm wondering if it's possible to have 3 leaderboard. Someting like that :

Results for A Participants - ID - Acc Results for B Participants ID Acc Results for C Participants - ID - Acc

The goal is to distinguish results for the 3 variants.

How I can write competition.yaml file to do this ?

Thank's in advance.

ihsaan-ullah commented 4 months ago

Hi @hpc100

At the moment we don't have multiple leaderboards feature in Codabench. We are planning to add this feature soon. For now you can use the same leaderboard with different column names e.g. Acc A, Acc B, Acc C.

Didayolo commented 4 months ago

That would indeed be useful.

I close this issue as this is reported here: