search

neulab / explainaboard_client

1 stars 1 forks source link

Upgrade task list #11

Closed neubig closed 2 years ago

neubig commented 2 years ago

Because this library (intentionally) doesn't rely on explainaboard, it is necessary to periodically copy-paste task IDs from the ExplainaBoard codebase. This is that copy-paste.

Blocked by upgrade of ExplainaBoard production server to v0.11.

lyuyangh commented 2 years ago

Hey @neubig ! Just a random thing I thought of today, this CLI is designed to interact with the public APIs of explainaboard_web so I think we can just query /api/tasks to get the tasks list. That way we don't need to manually update this list.

We can provide an explainaboard_cli update command that fetches the tasks and stores the list in a local file. argparse would read that file to determine the available options for tasks and metrics. Do you think this would work?