issues
search
triton-inference-server
/
triton_cli
Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.
48
stars
2
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Stream LLM
#86
EgyipTomi425
opened
6 days ago
0
Iteratively deleting model directories when running `triton remove -m all`
#85
KrishnanPrash
closed
3 weeks ago
0
Support with llama3.18b fine tuning
#84
jackNhat
opened
4 weeks ago
0
build: Upgrade to 24.08, TRT-LLM 0.12.0, and Triton CLI v0.0.11
#83
rmccorm4
closed
1 month ago
1
chore: Add Llama3.1-8B support for vLLM and use KIND_MODEL for vLLM config by default
#82
rmccorm4
closed
1 month ago
1
build: Upgrade to 24.07, TRT-LLM 0.11.0, and Triton CLI v0.0.10
#81
rmccorm4
closed
2 months ago
2
chore: Print inputs when using 'triton infer' and bump version to 0.0.10dev
#80
rmccorm4
closed
2 months ago
1
Tag 0.0.9 and update versions to 24.06
#79
rmccorm4
closed
2 months ago
1
chore: Update TRT-LLM checkpoint scripts to v0.10 and Fix Github Actions Pipeline
#78
KrishnanPrash
closed
3 months ago
1
fix: Use profile subcommand for GenAI-Perf starting in 24.08
#77
dyastremsky
closed
1 month ago
2
test: Shorten genai-perf test time, fail fast on server startup, and upgrade to 24.06
#76
rmccorm4
closed
2 months ago
0
Fix: Upgrading Triton-CLI support for TensorRT-LLM v0.10.0
#75
KrishnanPrash
closed
3 months ago
0
Update Triton CLI version
#74
mc-nv
closed
3 months ago
0
build: Update CLI version references to 0.0.8 and Triton references to 24.05
#72
rmccorm4
closed
4 months ago
2
Tag 0.0.7 appears to have stopped working - AttributeError
#71
IAINATDBI
closed
3 months ago
1
ci: Restrict numpy to version 1.x
#70
KrishnanPrash
closed
4 months ago
0
refactor: Add TritonCLIException to denote expected vs unexpected errors
#69
rmccorm4
closed
4 months ago
0
refactor: Simplify testing with ScopedTritonServer instead of pytest fixtures
#68
KrishnanPrash
closed
4 months ago
0
chore: Upgrade dependencies for 24.05
#67
KrishnanPrash
closed
4 months ago
0
test: Unit Tests for `triton {metrics, config, status}`
#66
KrishnanPrash
closed
4 months ago
1
Error importing Llama3-8b
#65
riosje
closed
4 months ago
8
Add GitLab CI trigger in GitHub checks
#64
nvda-mesharma
closed
4 months ago
0
Update .gitignore
#63
nvda-mesharma
closed
4 months ago
0
Add GitLab CI trigger in GitHub checks
#62
nvda-mesharma
closed
4 months ago
0
Tweak test timeouts to account for testing Llama 2 and Llama 3 models
#61
rmccorm4
closed
4 months ago
0
Fix wrong huggingface login command in readme
#60
matthewkotila
closed
5 months ago
0
Update test images to 24.04 and remove duplicate TRT-LLM install
#59
rmccorm4
closed
5 months ago
1
Disable Echo in TRT-LLM as Default
#58
nnshah1
closed
5 months ago
1
v0.0.7 Release
#56
rmccorm4
closed
5 months ago
0
Add llama-3-8b support and improve TRT-LLM build ergonomics
#55
rmccorm4
closed
5 months ago
1
[Triton 24.04] Bump TRT-LLM version to 0.9.0, add llama-3-8b, improve ergonomics of TRT-LLM engine building
#54
rmccorm4
closed
5 months ago
4
Document and unit test tools integrations
#53
dyastremsky
closed
5 months ago
1
Enable calls to GenAI-Perf for profile subcommand
#52
dyastremsky
closed
5 months ago
8
Shorter install command
#51
oandreeva-nv
closed
6 months ago
0
Address some documentation issues
#50
rmccorm4
closed
6 months ago
0
Failed to start server in 'docker' mode
#49
IAINATDBI
closed
6 months ago
3
Support for "chat" variant of Llama-2-7b model
#48
IAINATDBI
closed
5 months ago
10
Documentation suggestion
#47
IAINATDBI
closed
6 months ago
1
Unable to clone repo
#46
IAINATDBI
closed
6 months ago
1
Pip installation failed with conflicting tritonclient error
#45
yzhao-2023
closed
2 months ago
2
TRT-LLM Quickstart Guide
#44
fpetrini15
closed
4 months ago
0
README Restructuring
#43
fpetrini15
closed
7 months ago
0
Update README commands
#42
rmccorm4
closed
7 months ago
0
Enable CLI Concurrent Testing
#41
fpetrini15
closed
7 months ago
0
Flatten CLI Args
#40
fpetrini15
closed
7 months ago
2
Bump to v0.0.6 - CI testing working for 24.02
#39
fpetrini15
closed
7 months ago
2
Bump to v0.0.5 - CI testing working for 24.01
#38
rmccorm4
closed
7 months ago
0
CLI TRT LLM v0.8.0 Refresh
#37
fpetrini15
closed
7 months ago
3
Add extra tests for CLI
#36
krishung5
closed
7 months ago
0
Add CLI subcommand tests to CI
#35
krishung5
closed
7 months ago
0
Next