aws-samples awsome-inference issues

aws-samples / awsome-inference

MIT No Attribution

31 stars 10 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Mig

#35 amanshanbhag closed 6 days ago
0
Add sglang examples

#34 mhuguesaws opened 2 weeks ago
0
Made changes to multinode example (automating manual tasks)

#33 amanshanbhag closed 2 weeks ago
0
MoA

#32 EashanKaushik closed 3 weeks ago
0
Bump starlette from 0.38.6 to 0.40.0 in /3.use-cases/nims-inference/audio-bot/src/resources/twilioServer

#31 dependabot[bot] closed 3 weeks ago
0
add enc-dec t5 and mistral triton trtllm sagemaker example notebooks

#30 kshitizgupta21 closed 1 month ago
1
Fix links for multinode trtllm example

#29 kshitizgupta21 closed 1 month ago
0
Mixture of Agents

#28 EashanKaushik closed 3 weeks ago
0
fix container dockerfile link in deploy_triton.md and update gap example in multi-node triton trt-llm example

#27 kshitizgupta21 closed 1 month ago
0
add triton trtllm encdec sagemaker example

#26 kshitizgupta21 closed 1 month ago
0
feat: Audio bot

#25 schuettc closed 1 month ago
6
Cleaning up SM directory for NIM

#24 amanshanbhag closed 1 month ago
0
Outdated README... Updating with latest additions

#23 amanshanbhag closed 1 month ago
0
Create example using BioNeMo NIMs for generative virtual screening wo…

#22 flamingofugang closed 1 month ago
0
Adding in AD for deployment

#21 amanshanbhag closed 1 month ago
0
add lws based multi-node triton trtllm example

#20 kshitizgupta21 closed 1 month ago
2
Rayserve uri edits

#19 mvinci12 closed 2 months ago
1
genai-perf in benchmark_concurrency.sh with multi-lora got HTTP 404

#18 Ryan-ZL-Lin closed 1 month ago
3
feat: ec2 deployment

#17 schuettc closed 2 months ago
2
Add NIM test results and updated genai-perf.yaml

#16 JoeyTPChou closed 3 months ago
1
Change working_dir on Stable Diffusion ray service

#15 amanshanbhag closed 3 months ago
0
Accelerated instance containers need to have EFA, NCCL, OpenMPI, OFI-NCCL

#14 amanshanbhag closed 1 month ago
0
Rayserve fixed uri for stablediffusion/detr

#13 mvinci12 closed 3 months ago
0
Adding README maintenance instructions to CONTRIBUTING.md

#12 amanshanbhag closed 3 months ago
0
Rayserve

#11 mvinci12 closed 3 months ago
0
README change - adding "(optional)" next to 2.Test step as it can be misleading

#10 amanshanbhag closed 3 months ago
0
NIM Autoscaling + Load Balancing + Custom Metrics Monitoring

#9 amanshanbhag closed 2 months ago
0
UPDATE README AND UPLOAD MISTRAL AND LLAMA3 NIM notebooks

#8 nithiyn closed 3 months ago
3
UPDATE README AND UPLOAD MISTRAL AND LLAMA3 NIM notebooks

#7 nithiyn closed 3 months ago
0
update readme and upload notebooks for mistral and llama

#6 nithiyn closed 3 months ago
1
Capacity block eks

#5 amanshanbhag closed 3 months ago
0
Fixing links in README

#4 jimburtoft closed 4 months ago
0
Bump jinja2 from 3.0.3 to 3.1.4 in /2.projects/nims-inference/nims-on-sagemaker

#3 dependabot[bot] closed 3 months ago
0
Updated genai-perf.yaml to use r24.06

#2 JoeyTPChou closed 4 months ago
0
Fixed multi-gpu issue and refactored and optimized NIM benchmark

#1 JoeyTPChou closed 4 months ago
0