Thanks to the authors for sharing such fantastic work!
I've been attempting to replicate your article, and I've followed the configuration outlined in the supplementary materials: PHASE_ITERS=10, G_ITERS=100, METASURFACE=neural. I trained the code on a single RTX 3090 GPU, but I've consistently observed that the loss function fails to decrease, oscillating between 0.7 and 0.8. I'm wondering if I used the correct configuration.
By reading through the code, I've noticed that the parameters are updated only once after training PHASE_ITERS or G_ITERS, i.e. batch_size=1. Could it be possible that the loss oscillation is due to the batch size being too small?
Thanks to the authors for sharing such fantastic work!