search

huggingface / blog

Public repo for HF blog posts
https://hf.co/blog
2.14k stars 656 forks source link

Citation needed #2023

Closed saskra closed 2 months ago

saskra commented 2 months ago

https://github.com/huggingface/blog/blob/31b01eef087998604c9a379245af67fc9ec64e7f/leaderboard-medicalllm.md?plain=1#L88

Where do these statements and the subsequent diagram come from? Neither the Gemini model nor the medical specialties listed, such as dermatology, are mentioned again in the rest of the blog article or the leaderboard, nor is this specialty discussed in the linked paper.

saskra commented 2 months ago

PS: I found the source of the image: https://arxiv.org/abs/2402.07023 But why doesn't Gemini Pro appear on the leaderboard?

pcuenca commented 2 months ago

cc @clefourrier @pminervini.

monk1337 commented 2 months ago

@saskra Thank you for your interest. We will be updating the models this week and adding a few more.