search

Zhimin-C / Bridge3D

34 stars 8 forks source link

Pretrained Model Parameters Do Not Match the Model Built from base.yaml #8

Open chenttt2001 opened 2 days ago

chenttt2001 commented 2 days ago

Hello, author! I am encountering an issue where the pretrained model parameters I downloaded do not match the model constructed using the base.yaml configuration file.

Zhimin-C commented 2 days ago

When publishing the code to GitHub, I deleted some unused parts. That is why the parameters do not match.

chenttt2001 commented 2 days ago

Okay, I have adjusted the parameters in base.yaml so that most of the model's structure matches the parameter file, but there are still some MLP parameters that I couldn't find in the pretrained weights, as shown in the image below. Could you please share the pretrained weights that include these parameters? Snipaste_2024-10-28_13-28-45

Zhimin-C commented 2 days ago

In the fine-tuning stage of downstream tasks, only the plain transformer structure is used. Hence, the pre-trained weights of those parameters can be ignored in the fine-tuning stage.

chenttt2001 commented 2 days ago

Well, thank you for your help

chenttt2001 commented 1 day ago

I'm sorry to bother you again. Can you share the weights with these parameters? Maybe my research direction needs them to make some attemptsattempts

Zhimin-C commented 22 hours ago

Those parameters are not trained by loss and thus are just random numbers.

chenttt2001 commented 22 hours ago

Does that include img_proj?

chenttt2001 commented 21 hours ago

And why are the 3dter parameters I download at 3.Bridge3D Weights the same as pointmae weights?

Zhimin-C commented 21 hours ago

I have corrected the link in the readme file. Now you can download the pre-trained 3dter parameters and the correct pre-training weight. Sorry about that.

Zhimin-C commented 21 hours ago

you can now check the parameters in the pre-trained encoder. I just realized that the link in the README file was incorrect after the last update... Thanks for pointing out!

chenttt2001 commented 20 hours ago

You're welcome. Glad I could help