-
Hi,
I am a beginner of torch-mlir.
I can execute the `examples/torchscript_stablehlo_backend_tinybert.py` successfully and get the MLIR output.
I found that the constant matrices are with specif…
-
Hi Author,
Do you plan to release the tensorflow version of **tiny bert** in huggingface?
Thanks you so much.
-
What language BERT model would you like to be released next?
[![](https://api.gh-polls.com/poll/01DV684CCKWDXFMSPC2YHQVY63/Swedish)](https://api.gh-polls.com/poll/01DV684CCKWDXFMSPC2YHQVY63/Swedish…
-
楼主,你好,我跑tinybert,在iflytek数据集上效果非常差(如下结果),请问一下可能是哪方面的原因?
训练配置如下:未加数据增强,max_seq_length=128,train_batch_size=32,learning_rate=5e-5
02/10 07:18:14 PM ***** Eval results *****
02/10 07:18:14 PM acc …
-
hi,
I studied your article, but I have some questions if you could answer me.
1. what does the teacher bert means? it means the architecture of general bert?
2. we should train tiny bert from an e…
-
### System Info
Using CPU and kubernetes
CMD: infinity_emb v1 --model-name-or-path /mnt/model-storage/ms-marco-MiniLM-L-12-v2 --port 8452 --batch-size 32
### Information
- [ ] Docker
- [X] The CLI…
-
All Docker Images are not working.
pt and tf: tarfile.ReadError: file could not be opened successfully
and apline: numpy is missing
-
您好,下载了预训练好的小模型,但是发现有些常见的中文汉字没有再词表中,想问下原因,十分感谢您的分享!
-
I have question about speed of processing for query.
I followed installation guide and wrote small script for testing nboost:
```
import timeit
import requests
source_query_text = "vegas"
…
-
Hello,
should I expect a high f1 score when training only the first step (intermediate-layers) distillation on SQuAD1.1?
Thanks