-
Hi @huzeyann
Thanks for this repo. I went through your work and was wondering if you could provide some
code where you score the vision transformers on brainscore?
Is it available? Were you ab…
-
Hi, I would like to know if ViT supports Eetq and LoRA and if I can have an example of this:
`from transformers import ViTForImageClassification, ViTImageProcessor
from peft import get_peft_model, L…
-
We are trying to use KAN on ViT to replace MLP for training on ImageNet, and we welcome co-builds!
[Vision-KAN](https://github.com/chenziwenhaoshuai/Vision-KAN)
-
If you could also add vision/video transformer models, please. Thanks in advance
-
Hi,
I'm trying to constrain the generation of my VLMs using this repo; however i can't figure out the way to personalize the pipeline for handling inputs (query+image). Whereas it is documented as …
-
### System Info
from transformers import Phi3VModel, Phi3VConfig.
Fails with error:
ImportError: cannot import name 'Phi3VModel' from 'transformers' (/usr/local/lib/python3.10/dist-packages/transf…
-
# Vision Transformers are Overrated | Frank’s Ramblings
Attaining ViT/ConvNeXt performance with a couple of simple modifications to ResNet.
[https://frankzliu.com/blog/vision-transformers-are-overra…
-
![image](https://github.com/pytorch/examples/assets/81737228/940d626c-5101-41ae-a36f-496319c03b0a)
![image](https://github.com/pytorch/examples/assets/81737228/7ea00869-7dd0-48ac-b0ef-1b25d57cbccc)
…
-
### Your current environment
```shell
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
### 🚀 Feature
I am appreciated for your great job! However, I have a question. Can Layer-CAM be used with Vision Transformer Network? If it does work, what aspects should I change?
### Motivation & …