facebookresearch multimodal issues

facebookresearch / multimodal

TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.

BSD 3-Clause "New" or "Revised" License

1.43k stars 138 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Update finetune.py

#529 vishwvir-singh opened 1 month ago
2
Support Python 3.10 at least

#528 mjspeck opened 2 months ago
0
set bias=True for linear layer (#526)

#527 zhangtemplar closed 5 months ago
4
unify how to freeze some parameters for coca pre-training

#526 zhangtemplar closed 6 months ago
8
Cannot fine-tune CLIP model in GPU

#525 LioYao closed 7 months ago
5
update mypy version

#524 ebsmothers closed 7 months ago
3
Fix docstring of CLIP model

#523 willyfh closed 7 months ago
3
Replace torch.jit.instance with instance to assist torch.compile

#522 Bellaktris closed 7 months ago
4
create configuration file for MaMMUT training

#521 zhangtemplar closed 7 months ago
18
implement MaMMUT

#520 zhangtemplar closed 7 months ago
10
Add optional field for multimodal pooled embeddings

#519 zhangtemplar closed 8 months ago
5
Fixes for CoCa cascaded attention poolers

#518 ebsmothers closed 9 months ago
3
CoCa model implementation

#517 seungkyuK opened 9 months ago
1
Allow non-zero text pad token for Clip text transform

#516 ktnag closed 10 months ago
3
mini-imageNet

#515 HeYiyang2 opened 10 months ago
1
add another shape comment

#514 ebsmothers closed 10 months ago
1
add shape comment

#513 ebsmothers closed 10 months ago
1
update readme

#512 ebsmothers closed 10 months ago
5
Correcting cls token issues and enabling unified ViT-MAE

#511 ebsmothers closed 10 months ago
2
Change default logit scale in contrastive loss with temperature from parameter to float

#510 ebsmothers closed 11 months ago
4
Fix contrastive loss with temperature test

#509 ebsmothers closed 11 months ago
4
Fix mypy errors in diffusion labs/models/vae

#508 ebsmothers closed 11 months ago
3
Script for comparison of CoCa zero-shot to open_clip implementation

#507 ebsmothers opened 11 months ago
2
Add CoCa model

#506 ebsmothers closed 10 months ago
4
Train diffusion on MNIST

#505 sudhir2016 closed 11 months ago
2
Remaining fixes to unblock nightly build

#504 ebsmothers closed 11 months ago
4
test commit for nightly build w/o torchtext

#503 ebsmothers closed 11 months ago
0
fix blip2 gpu test

#502 pikapecan closed 11 months ago
2
Drop torchtext dependency in torchmultimodal/

#501 ebsmothers closed 11 months ago
3
Drop torchtext dep in OSS CLIP transform

#500 ebsmothers closed 11 months ago
8
Move BERTTextTransform into MUGEN example

#499 ebsmothers closed 11 months ago
4
Relax atol and rtol for MUGEN video VQVAE unit test

#498 ebsmothers closed 11 months ago
4
Utilities for deterministic unit tests

#497 ebsmothers closed 11 months ago
4
Add code for LDM

#496 abhinavarora opened 11 months ago
2
Added readme and example notebook for diffusion_labs

#495 pbontrager closed 11 months ago
3
[bugfix] Fix missing self in res/attn cond proj definitions

#494 ebsmothers closed 11 months ago
4
Add LDM VAE and its components to diffusion_labs

#493 abhinavarora closed 11 months ago
7
[just testing] Move off of nightly releases

#492 ebsmothers closed 11 months ago
1
Update and Add Diffusion Components

#491 pbontrager closed 11 months ago
6
[diffusion_labs] Move attention and res blocks under modules

#490 ebsmothers closed 11 months ago
9
ADMStack and ADMResBlock changes

#489 ebsmothers closed 11 months ago
6
Refactor ADM classes

#488 ebsmothers closed 11 months ago
6
Port BLIP-2 entire model to OSS folder

#487 pikapecan closed 12 months ago
2
add qformer model to torchmm/models

#486 pikapecan opened 12 months ago
7
add blip2 loss under torchmultimodal/modules/losses

#485 pikapecan opened 12 months ago
10
add blip2 layer under torchmm/models

#484 pikapecan opened 12 months ago
9
create blip2 folder and add qformer layers under torchmm/models

#483 pikapecan opened 12 months ago
12
Add support for LLaVA model

#482 youssefadr opened 12 months ago
7
Update linter versions

#481 ebsmothers closed 12 months ago
2
Reorg OSS Diffusion Components to diffusion_labs folder

#480 pbontrager closed 12 months ago
5