Ctransformers Mistral and Memory Profiling support

premAI-io / benchmarks

🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.

MIT License

130 stars 5 forks source link

Ctransformers Mistral and Memory Profiling support #165

Closed Anindyadeep closed 5 months ago

Anindyadeep commented 5 months ago

This PR introduces all the changes by PR #167 and integrates those in CTransformers. AutoCTransformers README now has quality checks table for both Llama 2 and Mistral

nsosio commented 5 months ago

@Anindyadeep let's fix conflicts and we can merge it

Anindyadeep commented 5 months ago

@Anindyadeep let's fix conflicts and we can merge it

sure

Anindyadeep commented 5 months ago

We are good to merge @nsosio