BradyFU / Awesome-Multimodal-Large-Language-Models

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models
10.88k stars 721 forks source link

What are expected to submit for the leaderboard integration? #124

Closed zhimin-z closed 4 months ago

zhimin-z commented 4 months ago

image

BradyFU commented 4 months ago

Hi Zhimin, you could send your WeChat ID to the email for further contact. Thanks!

zhimin-z commented 1 month ago

Hi Zhimin, you could send your WeChat ID to the email for further contact. Thanks!

Confirm with the leaderboard owner @BradyFU that they accept two methods for model evaluation following model owner identification:

  1. Model Access: Provide the model owner's access details for model API, repository, or configuration to conduct the evaluation.
  2. Evaluation Results: Submit evaluation results alongside the model access details for verification purposes.

Once the evaluations and verifications are complete, the leaderboard owner will incorporate the evaluation records into their existing leaderboards, ensuring accurate and up-to-date information for stakeholders.