issues
search
neuralmagic
/
guidellm
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
157
stars
11
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Multimodal
#66
anmarques
opened
21 hours ago
0
Does guidellm support benchmarking for SGlang
#65
jbymy2000
closed
4 days ago
1
Introduce the `--subset-size` CLI parameter
#64
parfeniukink
opened
1 week ago
0
Get Accuracy Metrics reported
#63
parfeniukink
opened
1 week ago
0
how to call the remote api
#62
jackqdldd
opened
1 month ago
0
Docs Updates
#61
rgreenberg1
opened
1 month ago
0
38 guidance reportjson from default flow is very large
#60
parfeniukink
opened
1 month ago
1
Docs Updates
#59
rgreenberg1
closed
1 month ago
0
Revert Summary Metrics and Expand Test Coverage to Stabilize Nightly/Main CI
#58
markurtz
closed
1 month ago
0
[Feature] GitHub Actions CI/CD Enablement and Expansion
#56
markurtz
opened
1 month ago
0
End-to-End Testing Enablement / Expansion
#55
rgreenberg1
opened
1 month ago
0
Integration Testing Enablement / Expansion
#54
rgreenberg1
opened
1 month ago
0
Change default "role" from "system" to "user"
#53
philschmid
closed
1 month ago
0
[bug] Model without system prompt fail
#52
philschmid
closed
1 month ago
3
FIX TGI example
#51
philschmid
closed
1 month ago
1
Add missing vllm docs link
#50
eldarkurtic
closed
1 month ago
0
Support on TGI (Text Generation Inference)
#49
muhammad-asn
closed
1 month ago
2
[Dataset]: Iterate through benchmark dataset once
#48
parfeniukink
closed
4 weeks ago
2
[Rate Type] Concurrencies
#47
philschmid
opened
2 months ago
2
Add summary metrics to saved json file
#46
anmarques
closed
1 month ago
4
Update README.md
#45
rgreenberg1
closed
1 month ago
0
[Dataset]: Iterate through benchmark dataset once
#44
philschmid
closed
4 weeks ago
6
ADD TGI docs
#43
philschmid
closed
1 month ago
0
✨ vLLM Backend integration
#42
parfeniukink
opened
2 months ago
0
images for cli.md
#41
rgreenberg1
closed
1 month ago
0
Quick fixes for failing tests for distribution regression
#40
markurtz
closed
2 months ago
0
Enhance Readme and CLI Configuration Options
#39
markurtz
closed
2 months ago
0
guidance_report.json from default flow is very large
#38
mgoin
opened
2 months ago
3
Wrong tokenizer used by default
#37
mgoin
closed
2 months ago
7
How to specify input/output token lengths for requests?
#36
mgoin
closed
2 months ago
0
Updated image in README
#35
jennyyangyi-magic
closed
2 months ago
0
Default guidellm command only sends empty messages?
#34
mgoin
opened
2 months ago
1
Refactor Benchmark Report Generation and Update Backend Configurations
#33
markurtz
closed
2 months ago
0
Rgreenberg1 patch 2
#32
rgreenberg1
closed
1 month ago
0
Create cli-user-guide
#31
rgreenberg1
closed
2 months ago
0
OpenaAI API Key secret is added to Github Actions
#30
parfeniukink
opened
2 months ago
2
✨Deepsparse Backend implementation
#29
parfeniukink
opened
2 months ago
0
Add Detailed Benchmark Progress Tracking and Enhanced Report Generation Features
#28
markurtz
closed
2 months ago
0
Refactor and Optimize Backend, Scheduler, and Test Suites for Improved Performance and Maintainability
#27
markurtz
closed
2 months ago
0
👷♂️ llama.cpp web server is added to GitHub Actions workflows
#26
parfeniukink
opened
2 months ago
0
Add pre-commit checks to quality workflows
#25
markurtz
closed
3 months ago
0
Add Report Generation and Configuration Improvements for GuideLLM
#24
markurtz
closed
3 months ago
0
Expand ruff configurations to enforce comprehensive code quality standards
#23
markurtz
closed
3 months ago
0
Add Serializable Functionality and GuidanceReport Class for Enhanced Results Management
#22
markurtz
closed
3 months ago
0
Enhance GuideLLM Documentation and Setup
#21
rgreenberg1
closed
2 months ago
1
👷♂️CI/CD includes build publishing
#20
parfeniukink
opened
3 months ago
1
Adapt build system for dynamic versioning and package naming based on build settings
#19
markurtz
closed
3 months ago
2
💄CLI interface improvements
#18
parfeniukink
closed
3 months ago
0
👔 Project settings is now encapsulated into `guidellm.config` module
#17
parfeniukink
closed
3 months ago
0
Add CI/CD workflows with tox and GitHub Actions for comprehensive testing, styling, and quality checks
#16
markurtz
closed
3 months ago
0
Next