issues
search
ELS-RD
/
transformer-deploy
Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer models 🚀
https://els-rd.github.io/transformer-deploy/
Apache License 2.0
1.64k
stars
150
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Encounter Error: ValueError: Message onnx.ModelProto exceeds maximum protobuf size of 2GB
#183
illumination-k
opened
5 months ago
0
the performance of onxx fp16 seems to be even worse than that of onnx fp32
#182
lierer007
opened
9 months ago
0
Replaced tensorrt.tensorrt imports to tensorrt for pip package compatibility
#181
CorentinJ
opened
9 months ago
0
Unable To use batching
#180
rahulmate
opened
10 months ago
1
unable to host .onnx model on triton server
#179
riyaj8888
opened
1 year ago
0
:wolf: fix python tokenizer path
#178
Pranjalya
opened
1 year ago
0
GPTModelWrapper' object has no attribute 'can_generate'
#177
jxcomeon
opened
1 year ago
1
unable to do tensorrt inference
#176
riyaj8888
opened
1 year ago
0
No supported GPU(s) detected to run this container
#175
sinankefeli
opened
1 year ago
0
transformer-deploy on triton server 22.08
#174
lakshaykc
closed
1 year ago
1
convert_model command not found
#173
pint1022
opened
1 year ago
3
Failed to load 'transformer_onnx_model'
#172
rifkybujana
closed
1 year ago
4
Tokenizer path
#171
vishalsrao
opened
1 year ago
0
Llama support
#170
michaelroyzen
opened
1 year ago
2
Torch 2.0
#169
varshith15
opened
1 year ago
3
Marginal Improvement Between INT8 and FP16
#168
alexriggio
opened
1 year ago
0
I faced with Stub process is unhealthy and it will be restarted.
#167
OleksandrKorovii
opened
1 year ago
0
Occasional "CUDA error cudaErrorInvalidConfiguration:invalid configuration argument" error
#166
zoltan-fedor
opened
1 year ago
1
sharing the code for the triton models.
#165
espoirMur
opened
1 year ago
0
Can we support facebook/m2m100_418M model?
#164
chi2liu
opened
1 year ago
0
How to deploy TrCOR
#163
SShimmyo
closed
1 year ago
2
ViT serving
#162
VoVoR
opened
1 year ago
0
quick question about the attribute "model_name" in `BertForTokenClassification`
#161
yc-wang00
closed
1 year ago
0
VDubbs
#160
VDubbs86
closed
1 year ago
0
Question-Answering example not working for batch_size > 1
#159
lakshaykc
opened
1 year ago
0
Support for constrained beam-search in T5
#158
junwang-wish
opened
1 year ago
0
Attempting to run T5 ORT model in Triton inference server
#157
samiur
opened
1 year ago
1
Two GPU are slower than one
#156
OleksandrKorovii
opened
1 year ago
0
Tensorrt engine
#155
imsiddhant07
opened
1 year ago
1
Token type ids bug
#154
fursovia
closed
1 year ago
3
Embedding with T5-Encoder
#153
DA-L3
opened
1 year ago
1
Bug fix for embedding task
#152
fursovia
closed
1 year ago
1
Auth token bug
#151
fursovia
closed
1 year ago
2
Unable to optimize microsoft/deberta-v3-small model
#150
hlkong323
opened
1 year ago
2
Unable to install transformer-deploy module
#149
elvinagam
closed
1 year ago
4
RepositoryNotFoundError when optimizing private HF model
#148
Matthieu-Tinycoaching
closed
1 year ago
0
How to create custom image with transformers pre-installed?
#147
tamaghna-dutta
closed
1 year ago
0
GPT-J 6B model
#146
timofeev1995
closed
1 year ago
2
Zero copy may lead to wrong text generation results
#145
brevity2021
opened
1 year ago
6
EncoderDecoderModel wrapper
#144
varshith15
closed
1 year ago
1
OpusMT conversion
#143
Matthieu-Tinycoaching
opened
1 year ago
1
fix: fix tensorrt inference in gpt2 notebook
#142
ayoub-louati
closed
1 year ago
0
fix: expose load_external_data for large models
#141
ayoub-louati
closed
1 year ago
1
Does the text generation instructions work for the ByT5 models? (byte-by-byte T5)?
#140
NOT-HAL9000
opened
1 year ago
1
encoder_hidden_states in the onnx inputs
#139
pngmafia
closed
1 year ago
3
[Question] Converting models over 2GB
#138
wkkautas
closed
1 year ago
3
fix: default device checked before device checking
#137
Thytu
closed
1 year ago
0
TypeError: unhashable type: 'slice'
#136
pngmafia
closed
1 year ago
2
Using t5-large in t5 notebook, the translation result is invalid
#135
brevity2021
opened
1 year ago
1
fix: update version with fix for private models
#134
ayoub-louati
closed
1 year ago
0
Next