-
### Question
In the process of scaling up the input image size within `clip_encoder.py`, the following adjustments have been made:
```
def load_model(self, device_map=None):
if sel…
-
- [ ] [Title: "Yi Model Family: Powerful Multi-Dimensional Language and Multimodal Models"](https://arxiv.org/html/2403.04652v1)
# Title: "Yi Model Family: Powerful Multi-Dimensional Language and Mul…
-
### Model description
Microsoft just open-sourced BEiTv3: https://github.com/microsoft/unilm/tree/master/beit3
This is a very powerful vision-language model that can be used as backbone for a vari…
-
Thanks, Authors for sharing the codes.
After running these two lines below:
```
python build_batches.py -d Gref -t train
python build_batches.py -d Gref -t val
```
it results in a "train_bat…
-
I want to quantize model from [open-flamingo](https://github.com/mlfoundations/open_flamingo) or https://github.com/open-mmlab/Multimodal-GPT (open-flamingo v1) before lora training,
https://github…
-
### Search before asking
- [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues.
### Component
Transforms/Other
### What happened + What you expect…
-
Hey all!
The video models are all supported in Transformers now and will be part of the v4.42 release. Feel free to check out the model checkpoints [here](https://huggingface.co/collections/llava-h…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
## Project Request
The goal of this project is to develop an AI-powered system that leverages natural language processing (NLP) and computer vision techniques to generate and manipulate text and im…
-
## installable
- [ ] https://github.com/salesforce/LAVIS
- https://github.com/salesforce/BLIP
- https://github.com/salesforce/ALBEF
- [ ] https://github.com/facebookresearch/multimodal
- …