-
### Feature request
I want to add the ability to use GGUF BERT models in transformers.
Currently the library does not support this architecture. When I try to load it, I get an error TypeError: Ar…
-
### Describe the bug
The `TokenClfDataset` is [initialized without a `model_name`](https://github.com/microsoft/LLMLingua/blob/60abc0f94939b24e000fe6a33a954de72055fa0c/llmlingua/prompt_compressor.p…
-
안녕하세요 공부중인 학생입니다..!
Bert CLS Attention Pooling hidden dimension을 256으로 하신 이유가 있을까요??
representation vector를 tokenized_data length(80)도 아니고 BERT hidden_size(768)도 아니고 왜 256으로 설정하셨는지 궁금합니다..!
-
在运行get_new_dev_list.py时，控制台输出日志显示：
11/20 10:40:53 AM: loading file E:/project/StAR_KGC-master/StAR_KGC-master/bert-base-uncased/bert-base-uncased-vocab.txt
11/20 10:40:53 AM: loading weights file E:…
-
### What is the issue?
embedding model
When I submit a single fragment, it responds normally, but when I submit multiple fragments, an exception occurs.
I encountered this error on different Wind…
-
### System Info
peft==0.13.0
### Who can help?
@EricLBuehler
### Information
- [ ] The official example scripts
- [X] My own modified scripts
### Tasks
- [ ] An officially supported task in th…
-
Thank you for your work on SGG.
I placed the BLIP pre-trained weights in cache/ckpts. However, when I start training, it still shows "Missing keys ['text_decoder.bert.embeddings.word_embeddings.wei…
-
Suppose we have a BERT NLI model trained to zero-shot classify texts given a prompt such as, for example, 'This text relates to cars.' Is it possible to use DSPy to optimise the prompt for such a mode…
-
The **_"name text_use_bert_cls is not defined"_** error occurs when trying to use explicit texts as mentioned in the 3rd example. The error occurs as the variable is not directly linked to the class …
-
使用您预训练的权重去进行语义推断，发现生成的句子是一些杂乱无章的单词拼凑而成，不知道是什么原因。
我的操作步骤是将bert-base-uncased的模型文件下载到本地，然后修改对应的模型路径…