triton-inference-server triton_cli issues

triton-inference-server / triton_cli

Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inference Server.

48 stars 2 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Stream LLM

#86 EgyipTomi425 opened 6 days ago
0
Iteratively deleting model directories when running `triton remove -m all`

#85 KrishnanPrash closed 3 weeks ago
0
Support with llama3.18b fine tuning

#84 jackNhat opened 4 weeks ago
0
build: Upgrade to 24.08, TRT-LLM 0.12.0, and Triton CLI v0.0.11

#83 rmccorm4 closed 1 month ago
1
chore: Add Llama3.1-8B support for vLLM and use KIND_MODEL for vLLM config by default

#82 rmccorm4 closed 1 month ago
1
build: Upgrade to 24.07, TRT-LLM 0.11.0, and Triton CLI v0.0.10

#81 rmccorm4 closed 2 months ago
2
chore: Print inputs when using 'triton infer' and bump version to 0.0.10dev

#80 rmccorm4 closed 2 months ago
1
Tag 0.0.9 and update versions to 24.06

#79 rmccorm4 closed 2 months ago
1
chore: Update TRT-LLM checkpoint scripts to v0.10 and Fix Github Actions Pipeline

#78 KrishnanPrash closed 3 months ago
1
fix: Use profile subcommand for GenAI-Perf starting in 24.08

#77 dyastremsky closed 1 month ago
2
test: Shorten genai-perf test time, fail fast on server startup, and upgrade to 24.06

#76 rmccorm4 closed 2 months ago
0
Fix: Upgrading Triton-CLI support for TensorRT-LLM v0.10.0

#75 KrishnanPrash closed 3 months ago
0
Update Triton CLI version

#74 mc-nv closed 3 months ago
0
build: Update CLI version references to 0.0.8 and Triton references to 24.05

#72 rmccorm4 closed 4 months ago
2
Tag 0.0.7 appears to have stopped working - AttributeError

#71 IAINATDBI closed 3 months ago
1
ci: Restrict numpy to version 1.x

#70 KrishnanPrash closed 4 months ago
0
refactor: Add TritonCLIException to denote expected vs unexpected errors

#69 rmccorm4 closed 4 months ago
0
refactor: Simplify testing with ScopedTritonServer instead of pytest fixtures

#68 KrishnanPrash closed 4 months ago
0
chore: Upgrade dependencies for 24.05

#67 KrishnanPrash closed 4 months ago
0
test: Unit Tests for `triton {metrics, config, status}`

#66 KrishnanPrash closed 4 months ago
1
Error importing Llama3-8b

#65 riosje closed 4 months ago
8
Add GitLab CI trigger in GitHub checks

#64 nvda-mesharma closed 4 months ago
0
Update .gitignore

#63 nvda-mesharma closed 4 months ago
0
Add GitLab CI trigger in GitHub checks

#62 nvda-mesharma closed 4 months ago
0
Tweak test timeouts to account for testing Llama 2 and Llama 3 models

#61 rmccorm4 closed 4 months ago
0
Fix wrong huggingface login command in readme

#60 matthewkotila closed 5 months ago
0
Update test images to 24.04 and remove duplicate TRT-LLM install

#59 rmccorm4 closed 5 months ago
1
Disable Echo in TRT-LLM as Default

#58 nnshah1 closed 5 months ago
1
v0.0.7 Release

#56 rmccorm4 closed 5 months ago
0
Add llama-3-8b support and improve TRT-LLM build ergonomics

#55 rmccorm4 closed 5 months ago
1
[Triton 24.04] Bump TRT-LLM version to 0.9.0, add llama-3-8b, improve ergonomics of TRT-LLM engine building

#54 rmccorm4 closed 5 months ago
4
Document and unit test tools integrations

#53 dyastremsky closed 5 months ago
1
Enable calls to GenAI-Perf for profile subcommand

#52 dyastremsky closed 5 months ago
8
Shorter install command

#51 oandreeva-nv closed 6 months ago
0
Address some documentation issues

#50 rmccorm4 closed 6 months ago
0
Failed to start server in 'docker' mode

#49 IAINATDBI closed 6 months ago
3
Support for "chat" variant of Llama-2-7b model

#48 IAINATDBI closed 5 months ago
10
Documentation suggestion

#47 IAINATDBI closed 6 months ago
1
Unable to clone repo

#46 IAINATDBI closed 6 months ago
1
Pip installation failed with conflicting tritonclient error

#45 yzhao-2023 closed 2 months ago
2
TRT-LLM Quickstart Guide

#44 fpetrini15 closed 4 months ago
0
README Restructuring

#43 fpetrini15 closed 7 months ago
0
Update README commands

#42 rmccorm4 closed 7 months ago
0
Enable CLI Concurrent Testing

#41 fpetrini15 closed 7 months ago
0
Flatten CLI Args

#40 fpetrini15 closed 7 months ago
2
Bump to v0.0.6 - CI testing working for 24.02

#39 fpetrini15 closed 7 months ago
2
Bump to v0.0.5 - CI testing working for 24.01

#38 rmccorm4 closed 7 months ago
0
CLI TRT LLM v0.8.0 Refresh

#37 fpetrini15 closed 7 months ago
3
Add extra tests for CLI

#36 krishung5 closed 7 months ago
0
Add CLI subcommand tests to CI

#35 krishung5 closed 7 months ago
0