search

premAI-io / benchmarks

🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
MIT License
117 stars 5 forks source link

Llamacpp mistral #171

Closed Anindyadeep closed 2 months ago

Anindyadeep commented 2 months ago

This PR introduces all the changes by PR https://github.com/premAI-io/benchmarks/pull/167 and integrates those in LlamaCPP. LlamaCPP README now has quality checks table for both Llama 2 and Mistral.

Additionally, it also removed docker support for now.

nsosio commented 2 months ago

@Anindyadeep can you merge dev?

Anindyadeep commented 2 months ago

@Anindyadeep can you merge dev?

Yes just removed the conflicts