-
Hi, I downloaded and ran your program, and got a training error as above. I have no GPU, so I changed the setup to fp16 = 'false' (xlnet left as your demo choice).
What's the problem?
Darrell…
-
Tutorial link: https://github.com/pytorch/tutorials/blob/master/intermediate_source/dynamic_quantization_bert_tutorial.rst
Version 1.8.0
Using either the Colab version or following the tutorial te…
-
As mentioned above.
-
Thanks for your work.
I found that there is no lr_layer_decay_rate for embedding layer, which is weird because embedding is actually below transformer layers.
-
### Describe the issue
I converted a xlnet model to onnx, and the model is 3 times slower compared to pytorch in centos 7. I tried add_session_config_entry("session.set_denormal_as_zero", "1") base…
-
TensorFlow版本的,例如CMRC2018和DRCD,谢谢!
-
First of all, thanks for creating this - as far as I can tell it's the only Pytorch local attention implementation that isn't a one-off created as part of a specific model.
My issue is that I'm usi…
-
python: 3.7
transformers: 4.9.2
pytorch: 1.8.1
```python
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("huawei-noah/TinyBERT_4L_zh")
model = AutoM…
-
I am trying to use xlnet base but getting an error:
learner = BertLearner.from_pretrained_model(databunch, args.model_name, metrics=metrics,
device=dev…
-
I am getting this error as soon as I get this
INFO:root:Writing example 0 of 9067886
I am running the standard code on a AWS Sagemaker with pytorch. Both the error stack and the code used is past…