Release of benchmark result

microsoft / JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

MIT License

23.58k stars 1.96k forks source link

Release of benchmark result #240

Open DhavalRepo18 opened 3 months ago

DhavalRepo18 commented 3 months ago

Can you release the predictions of TaskBench (for each of the three datasets) such that user do not need to run it again. Or point us where can we get the results.

https://github.com/microsoft/JARVIS/tree/main/taskbench

tricktreat commented 3 months ago

Thanks for your suggestion. We will upload the predictions files within two weeks.

DhavalRepo18 commented 2 months ago

@tricktreat any progress?

tricktreat commented 2 months ago

@DhavalRepo18 Sorry for the delay. I have uploaded the prediction files. You can access them at the following link: Link Password: 8888