ViTAE-Transformer / DeepSolo

The official repo for [CVPR'23] "DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spotting" & [ArXiv'23] "DeepSolo++: Let Transformer Decoder with Explicit Points Solo for Multilingual Text Spotting"
Other
250 stars 34 forks source link

Cannot use ViT as a backbone #54

Open kunalpurkayastha opened 11 months ago

kunalpurkayastha commented 11 months ago

Hello there, I'm facing the below issue while trying to finetune totaltext using VITAE backbone

Traceback (most recent call last): File "tools/train_net.py", line 368, in launch( File "/home/isi_cvpr/anaconda3/envs/scorpio/lib/python3.8/site-packages/detectron2/engine/launch.py", line 82, in launch main_func(*args) File "tools/train_net.py", line 293, in main trainer = Trainer(cfg) File "/home/isi_cvpr/anaconda3/envs/scorpio/lib/python3.8/site-packages/detectron2/engine/defaults.py", line 376, in init model = self.build_model(cfg) File "/home/isi_cvpr/anaconda3/envs/scorpio/lib/python3.8/site-packages/detectron2/engine/defaults.py", line 505, in build_model model = build_model(cfg) File "/home/isi_cvpr/anaconda3/envs/scorpio/lib/python3.8/site-packages/detectron2/modeling/meta_arch/build.py", line 22, in build_model model = META_ARCH_REGISTRY.get(meta_arch)(cfg) File "/home/isi_cvpr/Documents/Kunal/DeepSolo/adet/modeling/text_spotter.py", line 124, in init d2_backbone = MaskedBackbone(cfg) File "/home/isi_cvpr/Documents/Kunal/DeepSolo/adet/modeling/text_spotter.py", line 36, in init self.backbone = build_backbone(cfg) File "/home/isi_cvpr/anaconda3/envs/scorpio/lib/python3.8/site-packages/detectron2/modeling/backbone/build.py", line 32, in build_backbone backbone = BACKBONE_REGISTRY.get(backbone_name)(cfg, input_shape) File "/home/isi_cvpr/anaconda3/envs/scorpio/lib/python3.8/site-packages/fvcore/common/registry.py", line 71, in get raise KeyError( KeyError: "No object named 'build_vitaev2_backbone' found in 'BACKBONE' registry!"

I've run the convert-vitae.py from pretrained_backbone and followed all the steps like updating the weight path and all. Still I'm getting this issue over and over again. Please help me fix this issue