ray-project / llmperf

LLMPerf is a library for validating and benchmarking LLMs
Apache License 2.0
471 stars 69 forks source link

Are benchmark results released somewhere #9

Closed ogencoglu closed 6 months ago

ogencoglu commented 8 months ago

Thanks for this work!

Can we have access to some of your benchmarks without having to run them again? Is there some sort of leaderboard data available somewhere?

taivop commented 8 months ago

Same question to @waleedkadous. If not then I'd be happy to contribute to creating/hosting a public and open-source one.

richardliaw commented 7 months ago

hey! We will be publishing this soon :)

richardliaw commented 6 months ago

Hey @taivop and @ogencoglu , we've published a leaderboard here!

https://github.com/ray-project/llmperf-leaderboard

Feel free to contribute or comment.

ogencoglu commented 6 months ago

Awesome!

ogencoglu commented 6 months ago

The following would also be interesting to add: