YipengHu / label-reg

(This repo is no longer up-to-date. Any updates will be at https://github.com/DeepRegNet/DeepReg/) A demo of the re-factored label-driven registration code, based on "Weakly-supervised convolutional neural networks for multimodal image registration"
Apache License 2.0
117 stars 32 forks source link

The loss didn't decrease #24

Closed yunzhen closed 4 years ago

yunzhen commented 4 years ago

I try to use the framework to register fundus images.Because there's very little elastic transformation,I only use the globlenet rather than the composed net.,with vessels as label.However,the loss didn't decrease from the very beginning.

YipengHu commented 4 years ago

Thanks for the question, but I need more information help you to diagnose. Can you give me a few examples of these images and labels?

Yipeng


From: yunzhen notifications@github.com Sent: Monday, November 4, 2019 11:42:28 AM To: YipengHu/label-reg label-reg@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [YipengHu/label-reg] The loss didn't decrease (#24)

I try to use the framework to register fundus images.Because there's very little elastic transformation,I only use the globlenet rather than the composed net.,with vessels as label.However,the loss didn't decrease from the very beginning.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/YipengHu/label-reg/issues/24?email_source=notifications&email_token=AATX37IWPNMUJZS6GJO7HQTQSADCJA5CNFSM4JISK5T2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HWSJSVQ, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AATX37LFHAFJ5PHFETRE543QSADCJANCNFSM4JISK5TQ.

yunzhen commented 4 years ago

Thank you very much!I preprocessed the images before sending to the network.Please see the attachment. 图片1

YipengHu commented 4 years ago

Are they 2D - not sure the code can handle 2D images although the change should be minimal. Also, when you say not decreasing is it diverging or just not changing at all?, the latter probably means some error.

yunzhen commented 4 years ago

我重写了网络部分的代码,也修改了多尺度Dice的函数(把3D卷积改成2D,还有修改维度,其它没做改变),来适应二维图像。在网络训练过程中,loss初始为0.5左右,之后一直在0.480~0.50间来回浮动,尝试过调整学习率以及loss的scale,都没有用。

YipengHu commented 4 years ago

@yunzhen we have done the same for 2d images and it should work. Your problem should be general debugging/tuning problem. I'd suggest start with simple toy examples first to debug your own code.

YipengHu commented 4 years ago

I'm closing this now, but feel free to raise a new one if other specific problems.