microsoft SwinBERT issues

microsoft / SwinBERT

Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"

https://arxiv.org/abs/2111.13196

MIT License

238 stars 34 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Why not using weights of pre-trained BERT?

#57 Lyman-Smoker opened 2 months ago
0
where is "grad_acc" defined?

#56 CUPLC closed 4 months ago
0
docker image link can not be used.

#55 Koolvv closed 12 months ago
0
No such file or directory: 'datasets/VATEX/test.img.tsv'

#54 Koolvv closed 12 months ago
0
Combining Features of Swin Transformer and other Features

#53 adeljalalyousif opened 1 year ago
0
attention_scores= attention_scores + attention_mask

#52 Accept-AI opened 1 year ago
1
Issue arise training on HPC

#51 markllai opened 1 year ago
0
Missing Caption Files For YouCook2 Dataset

#50 fzohra opened 1 year ago
1
Is there any other settings? I run evaluation code directly always gets very low scores

#49 MUFCRyan closed 1 year ago
0
raise KeyError(key) from None KeyError: 'RANK'

#48 ybsu opened 1 year ago
2
Is there any parameter to tweak in the code to get longer captions?

#47 s3pi opened 1 year ago
0
How to download the raw videos of YouCook2?

#46 tiesanguaixia opened 1 year ago
1
FileNotFoundError: [Errno 2] No such file or directory: 'datasets/MSVD/frame_tsv/train_32frames.img.tsv'

#45 PureEidolon opened 1 year ago
5
Do the input lengths have to be fixed during training?

#44 riariam opened 1 year ago
0
Using Vatex dataset to train my own chinese data

#43 orangejhang opened 1 year ago
3
Questions about the value of 'loss_sparse_w' in command

#42 tiesanguaixia opened 1 year ago
1
Questions about masked_loss_img

#41 ylqi opened 1 year ago
0
How can I get frame_tsv/train_32frames.img.lineidx for MSVD?

#40 mohammadshahabuddin opened 1 year ago
3
What are the entire packages and dependencies for running the code? Is someone run the code in local conda environment successfully?

#39 tiesanguaixia closed 1 year ago
1
Train MSVD dataset using VATEX pretrained model? Thanks

#38 franciszchen opened 2 years ago
1
evalcap preparation

#37 franciszchen closed 2 years ago
2
container_abcs

#36 aleemomno opened 2 years ago
0
Questions About Frames extracting

#35 fringe-k opened 2 years ago
2
Could you please provide the file msvd-retrieval_train-val-test.json

#34 FingerRec closed 2 years ago
1
Missing swin_small.py

#33 RenShuhuai-Andy closed 9 months ago
1
anaconda environment instead of Docker

#32 adeljalalyousif opened 2 years ago
2
Adapt to custom datasets

#31 Swetha5 opened 2 years ago
0
oserror (errno 30) read-only file system python docker

#30 JoseponLee closed 2 years ago
3
Training my own dataset, but the indices equal 0 and in the output path (coco json format) don't have any caption.

#29 MingNarongthat opened 2 years ago
0
程序运行

#28 wxxxxxq opened 2 years ago
2
gpu memory requirements?

#27 mhyeonsoo closed 2 years ago
1
149.4 vs 120.6 for CIDEr on MSVD dataset

#26 willyfh closed 11 months ago
2
Question about learning rate in Multi-gpu training

#25 jkdxg8837 opened 2 years ago
1
The performance of adopting the Video Swin Transformer as offline-extracted video encoder?

#24 3DMM-ICME2022 opened 2 years ago
2
请问该代码支持多块gpu训练吗？

#23 ttx213 closed 2 years ago
3
Data split re MSVD and MSRVTT caption

#22 dxli94 opened 2 years ago
1
Can you directly provide the running environment of the code？ thank you！

#21 ttx213 opened 2 years ago
1
Using my own data to train

#20 MingNarongthat opened 2 years ago
0
About Attention Mask

#19 yangbang18 opened 2 years ago
1
TVC Dataset

#18 engindeniz opened 2 years ago
1
One data typo

#17 RyanLiut opened 2 years ago
1
Inference error with CPU

#16 rorobertostring opened 2 years ago
2
Trimming the YouCook2 videos + "./datasets/YouCook2/yc2_subtitles.jsonl"?

#15 movinghoon opened 2 years ago
4
The link to raw videos

#14 lzp870 opened 2 years ago
2
Training problems when reproduce the results of MSRVTT dataset

#13 yaolinli opened 2 years ago
17
Inconsistent reproduced results with the results reported in the paper

#12 QwCao closed 2 years ago
17
can't download pretrained models from the https://datarelease.blob.core.windows.net/swinbert/

#11 gurinvlad45 opened 2 years ago
4
A file is not found: no module named 'src.evalcap.coco_caption'

#10 QwCao closed 2 years ago
3
couldn't find msrvtt-32frm.zip

#9 ydwl-lynn closed 2 years ago
1
Can you share the train-val-test.json

#8 y382957894 closed 2 years ago
2