issues
search
huggingface
/
optimum-tpu
Google TPU optimizations for transformers models
Apache License 2.0
76
stars
19
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Jetstream by default
#118
tengomucho
opened
3 days ago
2
fix(test): correct nightly tests with random sampling
#117
tengomucho
closed
4 days ago
0
More Jetstream Pytorch fixes, prepare for release
#116
tengomucho
closed
5 days ago
5
fix(doc): correct link to deploy page
#115
tengomucho
closed
5 days ago
2
Support for Llama 3.1 and 3.2 fine tuning
#114
DimensionSTP
opened
6 days ago
1
Deployment link in doc is not correct
#113
tengomucho
closed
5 days ago
0
fix: graceful shutdown was not working with entrypoint, exec launcher
#112
co42
closed
2 weeks ago
0
Quantization Jetstream Pytorch
#111
tengomucho
closed
1 month ago
3
✏️ docs: Add training guide and improve documentation consistency
#110
baptistecolle
closed
1 month ago
2
Llama 3.2 1B Instruct on TPU v4, bumping transformers to 4.45.2
#109
artus-LYTiQ
opened
1 month ago
0
TPU v4 install guide
#108
artus-LYTiQ
opened
1 month ago
2
fix(docker): correct jetstream installation in TGI docker image
#107
tengomucho
closed
1 month ago
0
⛰ CI: mount hub cache and fix issues with cli
#106
tengomucho
closed
1 month ago
0
Test mount - not for review
#105
tengomucho
closed
1 month ago
1
Add CLI to install dependencies
#104
tengomucho
closed
1 month ago
1
🍃 Added Mixtral on TGI / Jetstream Pytorch
#103
tengomucho
closed
1 month ago
0
CI ephemeral TPUs
#102
tengomucho
closed
1 month ago
0
Fix ci nightly jetstream
#101
tengomucho
closed
1 month ago
0
ci: use ephemeral TPUs
#100
tengomucho
closed
1 month ago
1
💎 Gemma on TGI Jetstream Pytorch
#99
tengomucho
closed
1 month ago
0
fix(TGI Jetstream Pt): prefill should be done with max input size
#98
tengomucho
closed
1 month ago
0
Small TGI enhancements
#97
tengomucho
closed
1 month ago
0
🧹 Cleanup and fixes for TGI
#96
tengomucho
closed
1 month ago
0
Fix slow tests
#95
tengomucho
closed
2 months ago
2
Fix generation using Jetstream Pytorch
#94
tengomucho
closed
2 months ago
0
Correct extra token, start preparing docker image for TGI/Jetstream Pt
#93
tengomucho
closed
2 months ago
0
Add llama 31 support updated
#92
Bihan
opened
2 months ago
2
☝️ Update Jetstream Pytorch revision
#91
tengomucho
closed
2 months ago
0
🦙 Llama3 on TGI - Jetstream Pytorch
#90
tengomucho
closed
2 months ago
1
ci(docker): update torch-xla to 2.4.0
#89
tengomucho
closed
2 months ago
0
✈️ Introduce Jetstream/Pytorch in TGI
#88
tengomucho
closed
2 months ago
1
Add llama 31 support
#87
Bihan
closed
2 months ago
4
Update colab examples
#86
wenxindongwork
closed
3 months ago
4
Add support for llama 3.1 (8b) Fine Tuning & Inference
#85
Bihan
closed
2 months ago
4
Transformers `pipeline` API Support
#84
ndebuhr
opened
3 months ago
0
fix(ci): install doc builder explicitly
#83
tengomucho
closed
3 months ago
1
chore(pypi): remove direct dependency to doc-builder
#82
tengomucho
closed
3 months ago
0
Pypi release
#81
tengomucho
closed
3 months ago
1
Support for Llama-3.1 (8b) - inference
#80
Bihan
opened
3 months ago
7
feat(ci): set `fetch-depth: 0` in trufflehog checkout step
#79
tengomucho
closed
4 months ago
0
Fix instruct models UI issue
#78
tengomucho
closed
4 months ago
1
Issue running meta-llama-3-8b-instruct on Inference Endpoint
#77
pagezyhf
closed
4 months ago
1
Issue running mistral-7b-instruct-v0-3 on Inference Endpoint
#76
pagezyhf
closed
4 months ago
1
chore(tgi): update TGI base image
#75
tengomucho
closed
4 months ago
0
`/health` endpoint not working properly
#74
Edwinhr716
closed
4 months ago
3
Handle selector exception
#73
tengomucho
closed
4 months ago
0
Fix secret leak workflow
#72
tengomucho
closed
4 months ago
0
Lower TGI IE batch size
#71
tengomucho
closed
4 months ago
1
feat(cache): use optimized StaticCache class for XLA
#70
tengomucho
closed
4 months ago
1
Few more Inference Endpoints fixes
#69
tengomucho
closed
4 months ago
1
Next