issues
search
huggingface
/
optimum-tpu
Google TPU optimizations for transformers models
Apache License 2.0
66
stars
17
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
fix(TGI Jetstream Pt): prefill should be done with max input size
#98
tengomucho
closed
6 hours ago
0
Small TGI enhancements
#97
tengomucho
closed
1 day ago
0
🧹 Cleanup and fixes for TGI
#96
tengomucho
closed
5 days ago
0
Fix slow tests
#95
tengomucho
closed
1 week ago
2
Fix generation using Jetstream Pytorch
#94
tengomucho
closed
1 week ago
0
Correct extra token, start preparing docker image for TGI/Jetstream Pt
#93
tengomucho
closed
2 weeks ago
0
Add llama 31 support updated
#92
Bihan
opened
3 weeks ago
1
☝️ Update Jetstream Pytorch revision
#91
tengomucho
closed
2 weeks ago
0
🦙 Llama3 on TGI - Jetstream Pytorch
#90
tengomucho
closed
3 weeks ago
1
ci(docker): update torch-xla to 2.4.0
#89
tengomucho
closed
4 weeks ago
0
✈️ Introduce Jetstream/Pytorch in TGI
#88
tengomucho
closed
3 weeks ago
1
Add llama 31 support
#87
Bihan
closed
3 weeks ago
4
Update colab examples
#86
wenxindongwork
closed
1 month ago
4
Add support for llama 3.1 (8b) Fine Tuning & Inference
#85
Bihan
closed
1 month ago
4
Transformers `pipeline` API Support
#84
ndebuhr
opened
1 month ago
0
fix(ci): install doc builder explicitly
#83
tengomucho
closed
1 month ago
1
chore(pypi): remove direct dependency to doc-builder
#82
tengomucho
closed
1 month ago
0
Pypi release
#81
tengomucho
closed
1 month ago
1
Support for Llama-3.1 (8b) - inference
#80
Bihan
opened
1 month ago
7
feat(ci): set `fetch-depth: 0` in trufflehog checkout step
#79
tengomucho
closed
2 months ago
0
Fix instruct models UI issue
#78
tengomucho
closed
2 months ago
1
Issue running meta-llama-3-8b-instruct on Inference Endpoint
#77
pagezyhf
closed
2 months ago
1
Issue running mistral-7b-instruct-v0-3 on Inference Endpoint
#76
pagezyhf
closed
2 months ago
1
chore(tgi): update TGI base image
#75
tengomucho
closed
2 months ago
0
`/health` endpoint not working properly
#74
Edwinhr716
closed
2 months ago
3
Handle selector exception
#73
tengomucho
closed
2 months ago
0
Fix secret leak workflow
#72
tengomucho
closed
2 months ago
0
Lower TGI IE batch size
#71
tengomucho
closed
2 months ago
1
feat(cache): use optimized StaticCache class for XLA
#70
tengomucho
closed
2 months ago
1
Few more Inference Endpoints fixes
#69
tengomucho
closed
2 months ago
1
More Inference Endpoints features and fixes
#68
tengomucho
closed
2 months ago
1
Issues running finetuned versions of supported models
#67
Edwinhr716
opened
3 months ago
11
Several Inference Endpoint fixes
#66
tengomucho
closed
3 months ago
0
Text-generation-inference (TPU) container fixes
#65
Michellehbn
closed
2 months ago
4
fix(tgi): remove all the variables from entrypoint.sh
#64
mfuntowicz
closed
2 months ago
1
chore: bump to version v0.1.1
#63
tengomucho
closed
3 months ago
1
feat(TGI): add release docker image build and push to registry workflow
#62
tengomucho
closed
3 months ago
0
TGI version is not being passed through to the server make command in Dockerfile
#61
thealmightygrant
closed
3 months ago
1
chore: bump to version v0.1.0a1
#60
tengomucho
closed
3 months ago
1
Draft an integration of TGI with Jetstream/pytorch
#59
tengomucho
opened
3 months ago
1
feat: create an optimum export tool to convert a model to jetstream pt
#58
tengomucho
closed
1 month ago
1
Mistral nits
#57
tengomucho
closed
3 months ago
1
fix(ci): correct secrets leak workflow check
#55
tengomucho
closed
3 months ago
0
Add Mistral support 💨
#54
tengomucho
closed
3 months ago
6
fix(doc): update server and port when serving TGI
#53
tengomucho
closed
3 months ago
3
fix(tests): fix decode sample expected outputs again
#52
tengomucho
closed
3 months ago
0
FSDPv2 with Accelerate
#51
johnsutor
closed
3 months ago
2
fix(logging): correct logging usage
#50
tengomucho
closed
3 months ago
1
fix(build): add missing setuptools_scm section
#49
tengomucho
closed
4 months ago
0
chore(training): Allow training on torch xla > 2.3.0, add warning
#48
tengomucho
closed
4 months ago
1
Next