Bug fix around awq and int4 numbers for vllm.

premAI-io / benchmarks

🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.

MIT License

117 stars 5 forks source link

Closed Anindyadeep closed 5 months ago