issues
search
dandelin
/
ViLT
Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"
Apache License 2.0
1.36k
stars
209
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Question about GCC dataset download
#45
yr666666
opened
2 years ago
1
python run.py with data_root=content/datasets num_gpus=2 num_nodes=1 task_mlm_itm whole_word_masking=True step100k per_gpu_batchsize=64
#44
F-Yuan303
opened
2 years ago
6
Reproduce Flickr30k Evaluation results - DataSet problem
#43
JoanFM
closed
2 years ago
2
Incorrect dataset link.
#42
sunanhe
closed
2 years ago
1
Pre-training Time
#41
haoshuai714
closed
2 years ago
1
ViltTransformerSS usage clarification
#40
JoanFM
opened
2 years ago
10
missing values in vqa_dict.json
#39
csarron
closed
2 years ago
1
Visual Grounding
#38
prashan
opened
2 years ago
1
small difference between paper and code about token type embedding
#37
AAbathur
closed
2 years ago
2
Add ViLT to HuggingFace Transformers
#36
NielsRogge
closed
2 years ago
13
`self.mask_token` at 553 line in `vision_transformer.py`
#35
hspark1212
opened
2 years ago
6
Is it necessary to manually add the sampler in the dataloader?
#34
zhiqiangdon
closed
2 years ago
2
About finetune on f30k.
#33
GuoBruce
opened
2 years ago
2
inference image captioning
#32
trucvip123
opened
2 years ago
2
Possible out-of-memory issue of dataloader
#31
zhiqiangdon
closed
2 years ago
4
Download and process GCC and SBU
#30
wanng-ide
opened
2 years ago
10
Time cost when fine-tuning on COCO-irtr dataset
#29
simplelifetime
closed
2 years ago
2
License
#28
zdou0830
closed
2 years ago
2
Visualizations for VQA dataset
#27
aurooj
closed
2 years ago
0
Finetune on F30K IR/TR,why use itm
#26
DRACOyu
closed
2 years ago
0
Masked Patch Prediction
#25
Alloooshe
closed
2 years ago
1
itm and mlm training accuracy
#24
junchen14
opened
2 years ago
2
FLOPS calculation
#23
junchen14
opened
2 years ago
1
Do I have to download the pre-training weights of VILT or the pre-training weights of VIT
#22
CQUTWangHong
opened
2 years ago
3
Time Calculation
#21
menatallh
opened
2 years ago
6
AttributeError: module 'vilt' has no attribute 'modules'
#20
leonodelee
closed
2 years ago
4
Nearly 3 points below the provided VQAv2 fine-tuning result
#19
4444xhc
closed
3 years ago
2
got error when I turn on mpp (Masked Patch Prediction)
#18
GewelsJI
closed
3 years ago
8
The time consumption for pretraining
#17
junchen14
closed
3 years ago
1
Regarding pretraining time
#16
juhongm999
closed
3 years ago
2
Debug model
#15
hongzhenwang
opened
3 years ago
1
Question about image transformation: short edge is still 384 for the fine-tuning task?
#14
Jxu-Thu
closed
3 years ago
2
Flickr30k Finetune results does not match the provided checkpoint
#13
JACKHAHA363
opened
3 years ago
10
Unable to reproduce the 100k results
#12
JACKHAHA363
closed
3 years ago
8
Bump pillow from 8.1.0 to 8.2.0
#11
dependabot[bot]
closed
3 years ago
0
A very large batchsize requires 64 GPUs
#10
Jxu-Thu
opened
3 years ago
14
I reproduced the code of pytorch version, but get different result
#9
NostalgiaOfTime
closed
3 years ago
4
Finetuning VQA from checkpoint has unmatched keys
#8
JACKHAHA363
closed
3 years ago
1
Pretraining unstable
#7
liuhl-source
closed
3 years ago
2
python run.py with data_root="/arrows_flickr30k" num_gpus=1 num_nodes=1 task_finetune_irtr_f30k_randaug per_gpu_batchsize=4 load_path="vilt_200k_mlm_itm.ckpt"
#6
jkkishore1999
opened
3 years ago
15
python3 run.py with data_root=../../data/COCO num_gpus=2 num_nodes=1 task_mlm_itm whole_word_masking=True step200k per_gpu_batchsize=32
#5
jaeseokbyun
closed
3 years ago
2
python run.py with data_root=/data/workspace/dataset num_gpus=4 num_nodes=1 task_finetune_irtr_f30k_randaug per_gpu_batchsize=4 load_path="weights/vilt_200k_mlm_itm.ckpt"
#4
raojay7
closed
3 years ago
9
Error in PyTorch-Lightning when Finetuning on VQA
#3
tejas1995
closed
3 years ago
2
Data prepare
#2
liuhl-source
closed
3 years ago
2
Can you share 'vqa_dict.json' file for vqa_demo?
#1
Senwang98
closed
3 years ago
3
Previous