issues
search
premAI-io
/
benchmarks
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
MIT License
130
stars
5
forks
source link
Re-Iterate, Fix vLLM Benchmark and add Readme
#142
Closed
Anindyadeep
closed
8 months ago
Anindyadeep
commented
8 months ago
Solves issue #88
Solves issue #131
Checks:
[X] Check
setup.sh
and
bench.sh
have Python files configured for both Mac and Linux and installation working.
[X] Check if int32 < int16 and int8 < int4 patterns follow
[X] Check the log file name and where it is kept
[X] Check if all precisions can be covered or not and if not put an issue
[X] Check if all devices can be covered or not otherwise put an issue or find an issue (it's just memory issue and too slow, mentioned in Readme)
[X] Check the Benchmark README
Checks:
setup.sh
andbench.sh
have Python files configured for both Mac and Linux and installation working.