-
### What happened?
I ran into this issue when working on a [PR](https://github.com/huggingface/transformers/pull/31844) on HF where I was adding GGUF support for phi3 model.
When using gguf-my-…
-
I want to convert phi-2 model to MediaPipe format model by above link:
https://ai.google.dev/edge/mediapipe/solutions/genai/llm_inference#convert-model
But when I run it I encount the exception's …
-
**why subtract self.vocab_start_index**
```
def forward(self, input_):
assert not torch.any(
(input_ < 0) | (input_ >= self.num_embeddings)
), "An input token is o…
-
We link this to a Controlled Vocab from the EU Authority List. Because this vocab is missing some values that we need, we added another proprietary vocab. Both vocabs together provide the entire list …
-
Hello,
i am trying to use the model in julia/transformers.jl lib from the HuggingFace [dbmdz/german-gpt2](https://huggingface.co/dbmdz/german-gpt2)
After getting a error when loading the model, i fo…
-
**When I tried to run the provided colab program, I encountered the following probelm:**
![QQ截图20240910214626](https://github.com/user-attachments/assets/a6ab4d47-a026-4b69-815b-caf99e862735)
-
thanks for providing this toolset. i am unsure how utils.extend_model_vocab is intended to be used. in current form, it takes checkpoints only. when i try to adapt it to extend a model in safetensor f…
-
When I try to evaluate my model or make predictions on the val set, I get the following error:
```
---------------------------------------------------------------------------
ValueError …
-
[Skohub Vocabs](https://github.com/skohub-io/skohub-vocabs) is a flat file publication system for SKOS vocabularies based in git repositories. This may be suitable to provide browsing views and resolv…
-
请问一下不是说tokennizer里面会包含有这个模型所用的词表嘛?还是说做中文的文本生成,都要自己添加词表