awslabs llm-hosting-container issues

awslabs / llm-hosting-container

Large Language Model Hosting Container

Apache License 2.0

73 stars 23 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

trigger build

#86 e-davidson opened 1 day ago
0
chore: release tgi 2.2.0

#85 Captainia closed 4 days ago
0
TGI 2.2.0

#84 philschmid opened 4 days ago
0
Tei update 1 4 0

#83 philschmid closed 2 weeks ago
1
Add TGI 2.1.0

#82 philschmid closed 4 days ago
2
fix: apt-get upgrade

#81 evakravi opened 1 month ago
1
chore: cover Nvidia T4/L4 GPUs

#80 haixiw closed 1 month ago
0
Add Neuronx TGI 0.0.23

#79 dacorvo closed 1 month ago
1
Fix compute_cap access issue for TEI GPU image

#78 haixiw closed 2 months ago
0
feat: add TEI GPU & CPU image

#77 haixiw closed 2 months ago
2
chore: release tgi 2.0.3

#76 Captainia closed 2 months ago
2
TGI 2.0.3

#75 philschmid closed 4 weeks ago
2
Release Neuronx TGI 0.0.22

#74 Captainia closed 2 months ago
9
release tgi 2.0.2

#73 Captainia closed 2 months ago
3
Add TGI 2.0.2 and TGI NeuronX 0.0.22

#72 Captainia closed 2 months ago
1
Add Neuronx TGI 0.0.22

#71 philschmid closed 2 months ago
3
2-0-2

#70 philschmid closed 2 months ago
2
chore: add tgi 2.0.1

#69 haixiw closed 3 months ago
1
TGI 2.0.1

#68 philschmid closed 3 months ago
1
Add TEI Images

#67 philschmid closed 2 months ago
12
chore: add tgi 2.0.0

#66 haixiw closed 3 months ago
5
2 0 0

#65 philschmid closed 3 months ago
4
Add optimum NeuronX TGI 0.0.21 image

#64 dacorvo closed 3 months ago
2
chore: add TGI 1.4.5 image

#63 whittech1 closed 3 months ago
9
Add optimum NeuronX TGI 0.0.20 image

#62 dacorvo closed 4 months ago
2
release 1.4.2

#61 haixiw closed 5 months ago
1
Add optimum-neuron TGI 0.0.19

#60 dacorvo closed 4 months ago
4
fix: optimum 0.0.18

#59 jinyoung-lim closed 5 months ago
0
Release neuronx 0.0.18

#58 jinyoung-lim closed 5 months ago
0
fix: Copy Cargo.lock from tgi to respect pinned versions

#57 jinyoung-lim closed 5 months ago
1
Not able to get the files copied inside Dockerfile

#56 byash11 opened 5 months ago
4
chore: add optimum-neuron 0.0.18 image

#55 dacorvo closed 5 months ago
2
TGI 1.4.0

#54 amzn-choeric closed 5 months ago
1
ADD TGI 1.4.0

#53 philschmid closed 5 months ago
1
TGI 1.4.0

#52 timelfrink closed 5 months ago
1
Test

#51 amzn-choeric closed 6 months ago
0
Old Versions Archiving

#50 amzn-choeric closed 6 months ago
0
chore: add optimum version 0.0.17

#49 dacorvo closed 6 months ago
1
chore: device_version to cuda_version

#48 jinyoung-lim closed 6 months ago
0
feature: optimum-neuronx 0.0.16

#47 jinyoung-lim closed 6 months ago
0
overwrite test branch with changes including neuronx dockerfile

#46 jinyoung-lim closed 6 months ago
0
feature: optimum-neuronx 0.0.16

#45 jinyoung-lim closed 6 months ago
0
TGI 1.3.3

#44 amzn-choeric closed 7 months ago
1
TGI 1.3.1

#43 amzn-choeric closed 7 months ago
1
Add 1.3.1 with Mixtral

#42 philschmid closed 7 months ago
1
TGI 1.2.0

#41 amzn-choeric closed 7 months ago
1
TGI 1.2.0

#40 philschmid closed 7 months ago
1
Test

#39 amzn-choeric closed 8 months ago
0
Test Update & 1.03 Files (Testing)

#38 amzn-choeric closed 8 months ago
0
TGI Sanity Tests

#37 amzn-choeric closed 8 months ago
0