Ethan-Tseng / Neural_Nano-Optics

Repository for "Neural Nano-Optics for High-quality Thin Lens Imaging"
Boost Software License 1.0
73 stars 30 forks source link

Training-related issues #6

Closed LumaFilter closed 9 months ago

LumaFilter commented 10 months ago

Thanks to the authors for sharing such fantastic work!

  1. I've been attempting to replicate your article, and I've followed the configuration outlined in the supplementary materials: PHASE_ITERS=10, G_ITERS=100, METASURFACE=neural. I trained the code on a single RTX 3090 GPU, but I've consistently observed that the loss function fails to decrease, oscillating between 0.7 and 0.8. I'm wondering if I used the correct configuration.
  2. By reading through the code, I've noticed that the parameters are updated only once after training PHASE_ITERS or G_ITERS, i.e. batch_size=1. Could it be possible that the loss oscillation is due to the batch size being too small?
zwxdxcm commented 9 months ago

Hi, Is your problem solved? Could you share some of your solution? I am facing the similar issue of convergence. Thanks!