-
I noticed that GPT2Tokenizer is used when evaluating GPT2, which doesn't have a mask_token. Will this impact the evaluation result?
I think I should add a new one manually but I'm unsure which one I…
-
Python is doing a lot of heavy lifting and hiding a lot of the complexity. It'd be interesting to compare the Python GPT code with Kaparthy's pure C/CUDA implementaton of the same:
https://github.c…
-
**The bug**
When using `models.LlamaCpp` the selected tokenizer is always gpt2 (This can be seen in the outut when `verbose=True` arg is set). I have pasted the dumped KV metadat keys
```
llama_mod…
-
-
-
```python
import torch
from transformers import AutoTokenizer, AutoModelForCausalLM
@torch.compile(backend="turbine_cpu")
def test_gpt2_demo():
tokenizer = AutoTokenizer.from_pretrained("gp…
-
I am trying to lower GPT2 model to linalgIR but I am running into errors. I have built torch_mlir from source and have installed transformers with the latest version: pip install git+https://github.co…
-
## Bug Description
Configuration : llm_examples_main branch, current torch version : 2.4, transformers==4.41.2
Error message:
```py
File "/home/dperi/Downloads/TensorRT/examples/dynamo/torch_e…
-
### System Info
transformers 4.40.0
python 3.10
### Who can help?
@ArthurZucker
@Narsil
@SunMarc
### Information
- [ ] The official example scripts
- [x] My own modified scripts
…
-
If you are submitting a bug report, please fill in the following details and use the tag [bug].
**Describe the bug**
Gemma-2-{size} is not loadable using from_pretrained. I checked OFFICIAL_MODEL_…