codalab / codabench

Codabench is a flexible, easy-to-use and reproducible benchmarking platform. Check our paper at Patterns Cell Press https://hubs.li/Q01fwRWB0
Apache License 2.0
60 stars 26 forks source link

Codabench API: Leaderboard ID missing from phase information data #1436

Open johann-petrak opened 2 months ago

johann-petrak commented 2 months ago

https://www.codabench.org/api/docs/ specifies under GET /phases/{id}/ that the returned data should contain a key leaderboard which is an Integer, however, when I use that request on the codabench.org server, that key is NOT included in the return data. The keys present in the data returned are:

id
index
start
end
name
description
status
execution_time_limit
tasks
has_max_submissions
max_submissions_per_day
max_submissions_per_person
auto_migrate_to_this_phase
hide_output
public_data
starting_kit
is_final_phase
used_submissions_per_day
used_submissions_per_person

The phase (4755) definitely does have a leaderboard (with entries).

How else would one get the leaderboard id for a specific phase?

johann-petrak commented 2 months ago

The list of leaderboards in the competition information also does not show any relationship between the leaderboard and which phase it was used for.