usnistgov / jarvis_leaderboard

A large scale benchmark of materials design methods: https://www.nature.com/articles/s41524-024-01259-w
https://pages.nist.gov/jarvis_leaderboard/
Other
59 stars 44 forks source link

Benchmarks to add #14

Open knc6 opened 1 year ago

knc6 commented 1 year ago
sgbaird commented 1 year ago

Is the self-driving lab demo an appropriate benchmark dataset for the Jarvis leaderboard? https://self-driving-lab-demo.readthedocs.io/en/latest/tutorials.html

knc6 commented 1 year ago

Hi @sgbaird

Fantastic suggestion, yes, I think so. For instance, the color example notebook can be added in EXP category and say a new sub-category: SelfDriving, especially because it has well defined ground truth/reference. We can add probably other examples as well. Having a colab notebook example definitely helps.

sgbaird commented 1 year ago

Sounds great! Looking forward to chatting.