search

HansBambel / SmaAt-UNet

PyTorch-Code for the Paper "SmaAt-UNet: Precipitation Nowcasting using a Small, Attentive UNet-Architecture"
230 stars 43 forks source link

The result of test_precip_lightning.py #3

Closed yyyyqy closed 10 months ago

yyyyqy commented 1 year ago

After training UNet and other models separately, I changed the model_floder in the test_precip_lightning.py file as a way to change the different models, but I ended up with the same evaluation results. Is there a detail I'm not paying attention to?

HansBambel commented 1 year ago

The function get_model_losses uses every .ckpt-file and calculates the loss for each model. This was mainly used for comparing different models that were compared in the paper.

When you have only a single model (.ckpt-file) in the folder the loss will only be calculated for that model.

What do you have in your model_folder?

yyyyqy commented 1 year ago

When using the UNet model for prediction, my model_folder is: "F:/SmaAt_UNet_master/metric/UNet/", which has the ckpt files for 20 epochs as follow: 1676560392125 When using the UNetDS_Attention model for prediction, my model_folder is: "F:/SmaAt_UNet_master/metric/UNetDS_Attention/", which has the ckpt files for 20 epochs as follow: 1676560496806 Can you tell me what is wrong with it? Thanks!

HansBambel commented 1 year ago

Aah okay. You should place the best (or latest) file from each model in a separate folder. Then link that folder in test_precip_lightning.py.

Best here was for me the one with the lower validation error. Then only those two models are compared.

yyyyqy commented 1 year ago

Thanks, I know how the file should be put now. I looked at your code again and found that the code only has persistence's percision and other indicators. I will finish the rest by myself.

daralevian commented 1 year ago

Thanks, I know how the file should be put now. I looked at your code again and found that the code only has persistence's percision and other indicators. I will finish the rest by myself.

sorry to border，if I can ask you some question in private？I can‘t find your e-mail address

yyyyqy commented 1 year ago

Thanks, I know how the file should be put now. I looked at your code again and found that the code only has persistence's percision and other indicators. I will finish the rest by myself.

sorry to border，if I can ask you some question in private？I can‘t find your e-mail address

Sure, you can contact me at the following email address: cychyao@outlook.com