microsoft / JARVIS

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

MIT License

23.58k stars 1.96k forks source link

Are there plans to release the task planning evaluation procedure and datasets? #218

Closed downeykking closed 1 year ago

downeykking commented 1 year ago

As title. The latest revision of the ArXiv paper suggests a task planning evaluation procedure and datasets, but I can't seem to find that dataset anywhere. Are there any plans to release this dataset in the future?

Sorry if I've missed it somewhere but thanks regardless!

The same issues are like follows:

205 #208

StillKeepTry commented 1 year ago

Hi, @downeykking Thanks for your attention. We are currently working with our labeling teams to iteratively improve the quality of this dataset and our legal team to ensure compliance of the dataset release. We will release a work about this dataset in the future. please be patient.

downeykking commented 1 year ago

Got it, thanks!