Closed Anindyadeep closed 5 months ago
This PR introduces all the changes by PR https://github.com/premAI-io/benchmarks/pull/167 and integrates those in ExLlamaV2. ExLlamaV2 README now has quality checks table for both Llama 2 Chat and Mistral Instruct.
This PR introduces all the changes by PR https://github.com/premAI-io/benchmarks/pull/167 and integrates those in ExLlamaV2. ExLlamaV2 README now has quality checks table for both Llama 2 Chat and Mistral Instruct.