issues
search
triton-inference-server
/
client
Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
BSD 3-Clause "New" or "Revised" License
551
stars
227
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update scaling from ns to ms
#639
debermudez
closed
1 month ago
3
Add compare subcommand for visualizing multiple profile runs
#638
nv-hwoo
closed
5 months ago
0
Fix plot config test
#637
nv-hwoo
closed
5 months ago
1
Support custom artifacts directory and improve default artifacts directory
#636
nv-hwoo
closed
5 months ago
0
Extend genai perf plots to compare across multiple runs
#635
lkomali
closed
5 months ago
1
Fix missing dependency
#634
debermudez
closed
5 months ago
0
Support for fixed number of requests
#633
tgerdesnv
closed
5 months ago
0
Generate plot configurations for plot manager
#632
nv-hwoo
closed
5 months ago
0
Fixing memory leakage when using dlpack
#631
ParshikovMM
opened
5 months ago
4
AttributeError: 'InferenceServerClient' object has no attribute 'InferInput'
#630
Galoev
closed
5 months ago
3
Lock 'grpcio' package version
#629
mc-nv
closed
5 months ago
0
add --input-file support with new prompt source inference logic
#628
debermudez
closed
5 months ago
1
Add more metadata to profile export JSON file
#627
nv-hwoo
closed
5 months ago
2
Merge multiple SSE response into a single response
#626
nv-hwoo
closed
5 months ago
0
Fix input token calculation
#625
tgerdesnv
closed
5 months ago
0
Fixed file path for plot generation
#624
debermudez
closed
5 months ago
2
Add compare subcommand
#623
nv-hwoo
closed
5 months ago
1
Add workaround for missing 'object' field from vLLM OpenAI Completions API response
#622
matthewkotila
closed
5 months ago
0
Print PerfAnalyzerException message on exit
#621
matthewkotila
closed
5 months ago
0
Optimize the request body creation in HTTP python clients
#620
krishung5
closed
5 months ago
3
Update docs to revert naming: tensortllm to trtllm
#619
matthewkotila
closed
5 months ago
1
Update backend naming in docs: trtllm to tensortllm
#618
matthewkotila
closed
5 months ago
1
Fix typo and missing option in docs
#617
matthewkotila
closed
5 months ago
0
Update r24.04 branch docs to match structure of 24.03
#616
matthewkotila
closed
5 months ago
0
Update tutorial.md
#615
matthewkotila
closed
5 months ago
0
Fix Python Shm Client Leak
#614
fpetrini15
closed
5 months ago
1
return response metadata to associate it with request
#613
sydnash
opened
5 months ago
0
PA should check whether user-supplied inputs exist in the model
#612
dyastremsky
closed
3 months ago
0
Update main branch docs to match structure of 24.03
#611
matthewkotila
closed
5 months ago
0
ux improvements
#610
debermudez
closed
5 months ago
0
Update .gitignore to include GenAI-Perf artifacts
#609
matthewkotila
closed
5 months ago
0
Fix hardcoded profile export file name usage
#608
matthewkotila
closed
5 months ago
0
Add an option to set the path for saving files
#607
debermudez
closed
5 months ago
1
Remove trace file support in perf analyzer
#606
dyastremsky
closed
5 months ago
0
Remove release version from README
#605
dyastremsky
closed
5 months ago
0
Add new required option to enable graph generation
#604
debermudez
closed
5 months ago
0
Update trtllm to tensorrtllm where appropriate
#603
debermudez
closed
5 months ago
0
Silence download messaging with the first use of the tokenizer
#602
debermudez
closed
5 months ago
0
Remove GenAi-Perf known issue (echo is now disabled by default)
#601
dyastremsky
closed
5 months ago
3
Add guide on using files generated by GenAi-Perf
#600
dyastremsky
closed
5 months ago
3
Fix input token count
#599
tgerdesnv
closed
5 months ago
4
Memory leak in SharedMemoryTensor.__dlpack__
#598
vodnikss
opened
5 months ago
1
update error reporting
#597
debermudez
closed
5 months ago
2
nim fixes cherry pick
#596
debermudez
closed
5 months ago
0
Nim ci bug fixes
#595
debermudez
closed
5 months ago
0
Fix openai client header
#594
nv-hwoo
closed
5 months ago
0
Remove trace options in PA
#593
dyastremsky
closed
5 months ago
1
Improve input token accuracy
#592
dyastremsky
closed
5 months ago
1
Ignore openai chunk responses with no content
#591
tgerdesnv
closed
5 months ago
1
Continue to address readme VR feedback
#590
matthewkotila
closed
5 months ago
1
Previous
Next