premAI-io benchmarks issues

premAI-io / benchmarks

🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.

MIT License

116 stars 5 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

update: candle to latest & pin version

#189 swarnimarun opened 4 weeks ago
0
Max Engine by Mojo

#188 Anindyadeep opened 1 month ago
0
Incorrect results reported for TensorRT-LLM

#187 lopuhin opened 1 month ago
5
aphrodite-engine

#186 Anindyadeep opened 1 month ago
0
Use exllamav2's smart 4-bit KV cache for memory benchmark

#185 Interpause opened 1 month ago
1
Benchmarks v2 Merging dev to main

#184 Anindyadeep closed 2 months ago
0
Changes in Engine Readmes

#183 Anindyadeep closed 2 months ago
1
ONNX Runtime with mistral support and memory profiling

#182 Anindyadeep closed 2 months ago
1
Add model loading time for each benchmarks

#181 Anindyadeep opened 2 months ago
0
Add `torch.inference_session` on runner function

#180 Anindyadeep opened 2 months ago
0
Setup new md files from templates

#179 Anindyadeep closed 2 months ago
1
Nvidia TensortRT LLM Mistral, Memory support, qualitative comparision and improvements

#178 Anindyadeep closed 2 months ago
0
Optimum Nvidia Mistral, Memory support, qualitative comparision and improvements

#177 Anindyadeep closed 2 months ago
0
Change Main readme

#176 Anindyadeep closed 2 months ago
1
ExLlamaV2 Mistral, Memory support, qualitative comparision and improvements

#175 Anindyadeep closed 2 months ago
0
Lightning AI Mistral and memory integration

#174 Anindyadeep closed 2 months ago
0
Fix Transformers benchmark numbers

#173 Anindyadeep closed 2 months ago
0
vLLM Mistral, Memory support, qualitative comparision and improvements

#172 Anindyadeep closed 2 months ago
2
Llamacpp mistral

#171 Anindyadeep closed 2 months ago
2
CTranslate2 Benchmark with Mistral Support

#170 Anindyadeep closed 2 months ago
0
Update llama2.md.template with previous values.

#169 Anindyadeep closed 2 months ago
1
Deepspeed Mistral, Memory profiling support and empirical quality checks

#168 Anindyadeep closed 2 months ago
0
Addition of Mistral in HF Transformers with Quality comparison README and Logging Improvements

#167 Anindyadeep closed 2 months ago
2
Comments on output quality on main README

#166 Anindyadeep closed 2 months ago
2
Ctransformers Mistral and Memory Profiling support

#165 Anindyadeep closed 2 months ago
3
Make new dir only if dir does not exists

#164 Anindyadeep closed 2 months ago
0
AutoGPTQ Mistral, Memory profiling support and empirical quality checks

#163 Anindyadeep closed 2 months ago
3
For quality checks reference should be taken from actual PyTorch version of model

#162 Anindyadeep closed 2 months ago
1
Mistral AWQ with memory profiling

#161 Anindyadeep closed 2 months ago
2
Base class for code modularity and less redundancy

#160 Anindyadeep closed 2 months ago
0
Fix existing bugs before moving to next iterations

#159 Anindyadeep closed 3 months ago
2
Memory usage profiling support, code reduction refactor

#158 Anindyadeep closed 3 months ago
1
Improvements on logging and storing results

#157 Anindyadeep closed 2 months ago
1
New engines

#156 ogencoglu opened 5 months ago
0
Bug fix around awq and int4 numbers for vllm.

#155 Anindyadeep closed 5 months ago
0
Updated the table of contents.

#154 Anindyadeep closed 5 months ago
0
Added CTA to prem grant program.

#153 Anindyadeep closed 5 months ago
0
Added minor enhancement in the main readme.

#152 Anindyadeep closed 5 months ago
0
Added general Readme enhancements.

#151 Anindyadeep closed 5 months ago
0
Fix ML Engines and main Readme.

#150 Anindyadeep closed 5 months ago
0
Complete ML Engines Table

#149 nsosio closed 2 months ago
1
ML Engines

#148 nsosio closed 5 months ago
0
LM Deploy

#147 Anindyadeep closed 3 months ago
0
A nice blog containing all the analysis of benchmarks

#146 Anindyadeep closed 2 months ago
1
Revert "Revert "Re-Iterate, Fix Ctranslate2 Benchmark and add Readme""

#145 Anindyadeep closed 5 months ago
0
Revert "Re-Iterate, Fix Ctranslate2 Benchmark and add Readme"

#144 Anindyadeep closed 5 months ago
0
Additional command line argument `--clean` for clean installation.

#143 Anindyadeep opened 5 months ago
0
Re-Iterate, Fix vLLM Benchmark and add Readme

#142 Anindyadeep closed 5 months ago
0
TinyGrad Readme and small fixes.

#141 Anindyadeep closed 5 months ago
0
Re-Iterate, Fix TensorRT-LLM Benchmark and add Readme

#140 Anindyadeep closed 5 months ago
1