issues
search
premAI-io
/
benchmarks
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
MIT License
130
stars
5
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Re-Iterate, Fix TensorRT-LLM Benchmark and add Readme
#140
Anindyadeep
closed
8 months ago
1
Re-Iterate, Fix PyTorch Benchmark and add Readme
#139
Anindyadeep
closed
8 months ago
2
Re-Iterate, Fix Optimum Nvidia Benchmark and add Readme
#138
Anindyadeep
closed
8 months ago
0
Readme for ONNX Runtime.
#137
Anindyadeep
closed
8 months ago
1
Re-Iterate, Fix LlamaCPP Benchmark and add Readme
#136
Anindyadeep
closed
8 months ago
0
Re-Iterate, Fix LightningAI Benchmark and add Readme
#135
Anindyadeep
closed
8 months ago
1
Re-Iterate, Fix ExLlamaV2 Benchmark and add Readme
#134
Anindyadeep
closed
8 months ago
2
Re-Iterate, Fix DeepSpeed Benchmark and add Readme
#133
Anindyadeep
closed
8 months ago
0
Re-Iterate, Fix Ctranslate2 Benchmark and add Readme
#132
Anindyadeep
closed
8 months ago
0
Update and re-iterate the missing parts of benchmarks.
#131
Anindyadeep
closed
8 months ago
0
Re-Iterate, Fix CTransformers Benchmark and add Readme
#130
Anindyadeep
closed
8 months ago
0
Readme for Candle benchmark.
#129
Anindyadeep
closed
8 months ago
0
Re-Iterate, Fix Burn Benchmark and add Readme
#128
Anindyadeep
closed
8 months ago
0
Re-Iterate, Fix AutoGPTQ Benchmark and add Readme
#127
Anindyadeep
closed
8 months ago
0
Re-Iterate, Fix AutoAWQ Benchmark and add Readme
#126
Anindyadeep
closed
8 months ago
1
Fixes bug in README.md generation
#125
nsosio
closed
8 months ago
0
Latest benchmarks not updating.
#124
Anindyadeep
closed
8 months ago
0
Sync tables
#123
nsosio
closed
8 months ago
0
force trigger action
#122
nsosio
closed
8 months ago
0
bugfix in gha
#121
nsosio
closed
8 months ago
0
A template file for only tables as a single source of truth.
#120
Anindyadeep
closed
8 months ago
0
TensorRT support.
#119
Anindyadeep
closed
8 months ago
0
Readme update to show a first glance of benchmarks for Llama 2 GPU.
#118
Anindyadeep
closed
8 months ago
0
fix: score was in float16 but autoawq score should be for int4
#117
Anindyadeep
closed
8 months ago
0
An Evaluation Dataset for quality benchmarking of different inference engine implementation.
#116
Anindyadeep
closed
5 months ago
1
Check for FP-8 format also for Optimum Nvidia
#115
Anindyadeep
closed
6 months ago
1
DeepSpeed Benchmarking Support.
#114
Anindyadeep
closed
8 months ago
1
Fix required. Change `model_path` to `model_dir_path`
#113
Anindyadeep
closed
5 months ago
1
Some bug fixes that were spotted in HuggingFace.
#112
Anindyadeep
closed
8 months ago
0
Nvidia Optimum Support.
#111
Anindyadeep
closed
8 months ago
0
DeepSpeed FastGen
#110
Anindyadeep
closed
8 months ago
0
Lightning AI support
#109
Anindyadeep
closed
8 months ago
0
AutoAWQ support.
#108
Anindyadeep
closed
8 months ago
0
Additional performance benchmarks metric to give a overall picture of choosing a backend / framework.
#107
Anindyadeep
closed
5 months ago
2
We should also include the memory consumption for the devices.
#106
Anindyadeep
closed
5 months ago
1
PowerInfer
#105
filopedraz
opened
9 months ago
0
TensorRT-LLM Benchmark Support
#104
ucalyptus
closed
8 months ago
0
An optional docker container creation for each.
#103
Anindyadeep
closed
6 months ago
1
Benchmark along with a modular inference endpoint provider.
#102
Anindyadeep
closed
5 months ago
1
TinyGrad benchmark not working.
#101
Anindyadeep
closed
6 months ago
1
ONNX benchmark is not running.
#100
Anindyadeep
closed
5 months ago
3
Add benchmarking metric unit.
#99
Anindyadeep
closed
9 months ago
0
Benchmarks should be computed on other machines too
#98
filopedraz
closed
6 months ago
0
Include results in main README
#97
filopedraz
closed
8 months ago
1
Missing Unit of measure (Benchmarking ML engines)
#96
vittoriop17
closed
9 months ago
1
AutoGPTQ support.
#95
Anindyadeep
closed
9 months ago
3
An issue page which faced when running all benchmarks in A100 GPU.
#94
Anindyadeep
closed
5 months ago
3
Minor bug fix on docs and performance benchmarks.
#93
Anindyadeep
closed
9 months ago
1
Optimum With Nvidia
#92
Anindyadeep
closed
8 months ago
0
Code modularity, refactoring and re-usability.
#91
Anindyadeep
closed
5 months ago
1
Previous
Next