triton-inference-server model_analyzer issues

triton-inference-server / model_analyzer

Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

Apache License 2.0

423 stars 74 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Invalid genai-perf command line for LLM model type

#935 vlad-vinogradov-47 opened 1 day ago
1
Update README for r24.09

#934 pvijayakrish closed 6 days ago
0
Update the versions post 24.09 release.

#933 pvijayakrish closed 1 day ago
0
Installing model-analyzer How do I specify the dcgm version?

#932 XIAO-FAN-5257 opened 1 week ago
3
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf8 in position 0: invalid start byte

#931 Anas0x45 opened 3 weeks ago
0
[DO NOT MERGE] Update README and versions for 24.09

#930 pvijayakrish opened 3 weeks ago
0
Update MA version in master post 24.08

#929 pvijayakrish closed 1 month ago
0
Update README.md for 24.08 Release.

#928 pvijayakrish closed 1 month ago
0
Model_analyzer 1.42 creating config with kind_gpu only

#927 Kanupriyagoyal closed 4 weeks ago
5
Update README and versions for 1.43.0 / 24.08

#926 pvijayakrish closed 1 month ago
0
PA Migration: Doc Updates

#925 fpetrini15 closed 1 month ago
1
Fix problem with BLS quickstart example

#924 nv-braf closed 1 month ago
0
Adding note to warn user about custom backend in docker mode

#923 nv-braf closed 2 months ago
0
Updating documentation based on VDR

#922 nv-braf closed 2 months ago
0
Creating new generator class for concurrency sweeping

#921 nv-braf closed 2 months ago
0
model_analyzer.model_analyzer_exceptions.TritonModelAnalyzerException: The first 2 attempts to acquire measurements have failed.

#920 gizarchik opened 2 months ago
1
Update README for 24.07 branch

#919 pvijayakrish closed 2 months ago
0
Update NGC versions post-24.07 release

#918 pvijayakrish closed 2 months ago
0
Fixing copyright issue

#917 nv-braf closed 2 months ago
0
Deleted

#916 ccchow closed 2 months ago
0
Add request rate parameter for optuna search

#915 lkomali closed 2 months ago
2
Trigger CI on Pull Requests

#914 nvda-mesharma opened 2 months ago
0
Add Optuna Seed to Checkpoint

#913 nv-braf closed 2 months ago
0
Optuna CI Testing

#912 nv-braf closed 2 months ago
0
Add support for multi-model profiling to the Optuna RCG

#911 nv-braf closed 2 months ago
0
DCGM initialization error

#910 minhhoai1001 opened 2 months ago
1
Update README and versions for 1.42.0 / 24.07

#909 fpetrini15 closed 2 months ago
0
wrong with --triton-launch-mode=remote

#908 RheaRia opened 3 months ago
1
How to analyze large models like llama 3 70B that requires model parallelism?

#907 ccchow opened 3 months ago
3
How to sweep GPUs using Model Analyzer

#906 lionsheep24 opened 3 months ago
1
Update README.md for 24.06

#905 mc-nv closed 3 months ago
0
Update 'main' branch post-24.06

#904 mc-nv closed 3 months ago
0
Adding ensemble support to optuna

#903 nv-braf closed 3 months ago
2
Add BLS support to Optuna

#902 nv-braf closed 3 months ago
0
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf8 in position 0: invalid start byte

#901 kyosukegg opened 3 months ago
7
Adding BLS to OptunaRCG

#900 nv-braf closed 3 months ago
2
Adds BLS scaffolding to everything up to OptunaRCG

#899 nv-braf closed 3 months ago
0
Adding BLS composing models to SearchParameters

#898 nv-braf closed 3 months ago
0
Update README file

#897 mc-nv closed 3 months ago
0
Optuna Search Mode (Alpha) Release

#896 nv-braf closed 3 months ago
0
Documentation update for Optuna (alpha release)

#895 nv-braf closed 3 months ago
0
Documentation update for Optuna (alpha release)

#894 nv-braf closed 3 months ago
0
Option to disable concurrency sweeping

#893 nv-braf closed 4 months ago
0
Adding support for client batch size

#892 nv-braf closed 4 months ago
0
Check that model supports dynamic batching when creating param_combo

#891 nv-braf closed 4 months ago
0
Optuna Early Exit

#890 nv-braf closed 4 months ago
0
Add Debug info to Optuna

#889 nv-braf closed 4 months ago
0
Update main post 24.05 release

#888 tanmayv25 closed 4 months ago
0
Update 'main' to track development for 1.41.0 / 24.06

#887 tanmayv25 closed 4 months ago
0
Update 'main' to track development for 1.41.0 / 24.06

#886 tanmayv25 closed 4 months ago
0