issues
search
neuralmagic
/
guidellm
Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
Apache License 2.0
124
stars
6
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Docs Updates
#61
rgreenberg1
opened
4 days ago
0
38 guidance reportjson from default flow is very large
#60
parfeniukink
opened
4 days ago
1
Docs Updates
#59
rgreenberg1
closed
4 days ago
0
Revert Summary Metrics and Expand Test Coverage to Stabilize Nightly/Main CI
#58
markurtz
closed
5 days ago
0
[Feature] GitHub Actions CI/CD Enablement and Expansion
#56
markurtz
opened
6 days ago
0
End-to-End Testing Enablement / Expansion
#55
rgreenberg1
opened
1 week ago
0
Integration Testing Enablement / Expansion
#54
rgreenberg1
opened
1 week ago
0
Change default "role" from "system" to "user"
#53
philschmid
closed
6 days ago
0
[bug] Model without system prompt fail
#52
philschmid
closed
5 days ago
3
FIX TGI example
#51
philschmid
closed
5 days ago
1
Add missing vllm docs link
#50
eldarkurtic
closed
1 week ago
0
Support on TGI (Text Generation Inference)
#49
muhammad-asn
closed
1 week ago
2
[Dataset]: Iterate through benchmark dataset once
#48
parfeniukink
opened
1 week ago
1
[Rate Type] Concurrencies
#47
philschmid
opened
1 week ago
2
Add summary metrics to saved json file
#46
anmarques
closed
1 week ago
4
Update README.md
#45
rgreenberg1
closed
6 days ago
0
[Dataset]: Iterate through benchmark dataset once
#44
philschmid
opened
2 weeks ago
6
ADD TGI docs
#43
philschmid
closed
1 week ago
0
✨ vLLM Backend integration
#42
parfeniukink
opened
2 weeks ago
0
images for cli.md
#41
rgreenberg1
closed
5 days ago
0
Quick fixes for failing tests for distribution regression
#40
markurtz
closed
2 weeks ago
0
Enhance Readme and CLI Configuration Options
#39
markurtz
closed
2 weeks ago
0
guidance_report.json from default flow is very large
#38
mgoin
opened
2 weeks ago
3
Wrong tokenizer used by default
#37
mgoin
closed
2 weeks ago
7
How to specify input/output token lengths for requests?
#36
mgoin
closed
2 weeks ago
0
Updated image in README
#35
jennyyangyi-magic
closed
2 weeks ago
0
Default guidellm command only sends empty messages?
#34
mgoin
opened
2 weeks ago
1
Refactor Benchmark Report Generation and Update Backend Configurations
#33
markurtz
closed
3 weeks ago
0
Rgreenberg1 patch 2
#32
rgreenberg1
closed
5 days ago
0
Create cli-user-guide
#31
rgreenberg1
closed
3 weeks ago
0
OpenaAI API Key secret is added to Github Actions
#30
parfeniukink
opened
3 weeks ago
2
✨Deepsparse Backend implementation
#29
parfeniukink
opened
3 weeks ago
0
Add Detailed Benchmark Progress Tracking and Enhanced Report Generation Features
#28
markurtz
closed
3 weeks ago
0
Refactor and Optimize Backend, Scheduler, and Test Suites for Improved Performance and Maintainability
#27
markurtz
closed
3 weeks ago
0
👷♂️ llama.cpp web server is added to GitHub Actions workflows
#26
parfeniukink
opened
3 weeks ago
0
Add pre-commit checks to quality workflows
#25
markurtz
closed
1 month ago
0
Add Report Generation and Configuration Improvements for GuideLLM
#24
markurtz
closed
1 month ago
0
Expand ruff configurations to enforce comprehensive code quality standards
#23
markurtz
closed
1 month ago
0
Add Serializable Functionality and GuidanceReport Class for Enhanced Results Management
#22
markurtz
closed
1 month ago
0
Enhance GuideLLM Documentation and Setup
#21
rgreenberg1
closed
2 weeks ago
1
👷♂️CI/CD includes build publishing
#20
parfeniukink
opened
1 month ago
1
Adapt build system for dynamic versioning and package naming based on build settings
#19
markurtz
closed
1 month ago
2
💄CLI interface improvements
#18
parfeniukink
closed
1 month ago
0
👔 Project settings is now encapsulated into `guidellm.config` module
#17
parfeniukink
closed
1 month ago
0
Add CI/CD workflows with tox and GitHub Actions for comprehensive testing, styling, and quality checks
#16
markurtz
closed
1 month ago
0
🔨 `guidellm` build script is added
#15
parfeniukink
closed
1 month ago
0
➕ pytest-cov is installed. 75% threshold is set
#14
parfeniukink
closed
1 month ago
0
➕ pytest-cov is installed. 75% threshhold is set
#13
parfeniukink
closed
1 month ago
1
Add Pre-Commit Hooks and Fix Dev Dependency Issues
#12
markurtz
closed
2 months ago
1
✨ Executor & Scheduler packages preparation
#11
parfeniukink
closed
1 month ago
5
Next