Could an example task.json be provided - Githubissues

facebookresearch / dynalab

The Python library with command line tools to interact with Dynabench(https://dynabench.org/), such as uploading models.

MIT License

54 stars 10 forks source link

Could an example task.json be provided #113

Open walterwang opened 2 years ago

walterwang commented 2 years ago

For TaskIO, I was wondering what should the task.json file look like for the existing tasks. Thanks

TristanThrush commented 2 years ago

The task.json is not something that Dynalab users have to define themselves. It is provided by the task owner and loaded by Dynalab automatically. For any dynabench task, you should be able to inspect the task IO by following this README: https://github.com/facebookresearch/dynalab/blob/37b61e54dcbf43f76a447b290c44c1d5244ca1a7/dynalab/tasks/README.md

If you want even more info about task IO, feel free to read this too: https://github.com/facebookresearch/dynabench/blob/main/docs/owners.md#annotation-configs

Let me know if there are issues with these documents.