-
I had a passing idea about whether it is possible to use quantization for embedding models using Mistral?
However, one problem is that currently the checkpoint lacks the ``lm-head`` part, so I'm wo…
-
in the file unilm/deltalm/test.py i am trying to load deltalm model but I got this error,
I think that the model.pt itself doesn't have the required configuration or model state
can you help me fix…
-
Thanks for the well-written package! The RetNet's official implementation had several updates at https://github.com/microsoft/unilm/blob/master/retnet/README.md#changelog .
-
有没有 seq2seq的demo 类似 unilm 基于bert的
-
build_transformer_model()传入的参数application可以是encoder、lm、unilm,我看到你2020.3.5更新application=seq2seq为application=unilm,所以application=unilm是默认使用unilm进行seq2seq类型的任务吗?因为unilm是可以进行NLU任务的。
提问时请尽可能提供如下信息…
-
**Describe the bug**
Model I am using UniLM:
I use the following code to load the model.
```
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("micro…
-
If I want to train UniLM from scratch on another abstract summarization task (not in English), how do I do it?
I guess the fine tuning and inference code from Readme can be reused, but I'm not sur…
-
**Describe**
Model I am using (UniLM, MiniLM, LayoutLM ...):
Hello! Personally, I like this model very much. I used it to fine-tune the downstream tasks and easily achieved good results. I'm curious…
-
Hi,
I found some wrong annotations with misplaced bounding boxes in Mario-LAION after I downloaded the images in the url.txt.
Here are several examples:
Are these the examples with i…
-
Thanks for the well-written package! The RetNet's official implementation had several updates at https://github.com/microsoft/unilm/blob/master/retnet/README.md#changelog .