-
Description
Welcome to the 'DSWP' Team, good to see you here.
With this issue, readers will get introduced to the core information about 'Vision Transformers' along with sample code completely in …
-
I am trying to apply SmoothQuant during W8A8 quantization of `meta-llama/Llama-3.2-11B-Vision-Instruct` where I ignore all of the modules except for language_model. However I find that it crashes when…
-
Hi,
Thank you for your awesome work! I would like to know if there is any plan on supporting vision-based Transformer? As transformers are becoming popular in vision tasks, I believe this will be a…
-
I am facing this error while trying to fine-tune the phi3.5 vision model with lora.
created the virtual env based on the environment.yaml file,
all the library version are as mentioned.
```
[r…
-
## Description
I attempted to compile a Hugging Face model (the Hugging Face model link is: https://huggingface.co/OpenGVLab/InternViT-6B-448px-V1-5, which includes both the model architecture code …
-
Sure it can do basic stuff , but need deeply nested one .
also show overrides not getting stopped on in User files .
then add DSL examples for other xml based for st for generating image , pdf e…
-
Using the latest version of unsloth (i.e., `2024.11.11`), I only receive nonsensical answers from Qwen-2VL but only when loaded in 4bit (full precision works fine). Here's a minimally reproducible exa…
-
# New Operator
Self Attention
### Describe the operator
Multi-headed attention is seeing prolific use in all transformers (mostly described in [pytorch](https://pytorch.org/docs/stable/generated/t…
dfiru updated
3 weeks ago
-
Thank you for contributing such outstanding work, I would like to ask InternVideo2 support Chinese text search video? What model do I need to replace the VisionEncoder and TextEncoder with? Or how to …
-
## 🚀 Feature
Modularize `nn.MultiHeadAttention` / `nn.functional.multi_head_attention_forward()` and generalize the `nn.Transformer` modules so that:
1. Novel attention functions can be use…