mlcommons / modelbench

Run safety benchmarks against AI models and view detailed reports showing how well they performed.
https://mlcommons.org/ai-safety/
Apache License 2.0
60 stars 9 forks source link

remove SUTs no longer provided by Together and move smoke test earlier #431

Closed dhosterman closed 1 month ago

github-actions[bot] commented 2 months ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

wpietri commented 2 months ago

Oops, @dhosterman, I had missed your PR. Would you mind just adding my SUT changes into yours and merging it? I want to preserve the v0.5 original set in the code until we remove v0.5 entirely.

dhosterman commented 1 month ago

@wpietri , you bet, I'll do this now.

wpietri commented 1 month ago

Thanks!