Closed yolo01826 closed 1 week ago
@kevin-thankyou-lin @Aaditya-Prasad
I have had runs with loss 'curves' that look like what you're seeing; I copied loss and mse error from one of our real world training runs below:
We have had runs (in sim) without the loss spikes results (though you can see overfitting):
The loss spikes do appear only in the DSM loss (1), the CTM loss (2) is much more regular:
so the first thing I'd try would be to log the sampled noise scales for the DSM loss and see if the spikes happen when very ood noise scales are sampled. I didn't get a chance to try this due to timelines. It'd also be reasonable to play around with the learning rate, relative loss balancing, and making sure the dataset is properly shuffled.
Thank you very much for your work. Previously, under your guidance, we successfully completed the plug-in task using the original DP. Following the same parameter configuration from your consistency policy in the simulation task, we trained the EDM and CTMP strategies for the plug-in task. However, the resulting CTMP curve appears quite strange. Could you advise if there are any changes needed in the parameter settings for strategies in the real environment? EDM training curve as shown in the attached image.![image](https://github.com/user-attachments/assets/e53294b2-c824-4abc-b41a-f6afc7cf4fe8)
CTMP training curve as shown in the attached image.
![image](https://github.com/user-attachments/assets/1d18b3f5-9224-4675-b092-a692e5a0620a)
Thank you!