qianqianwang68 / omnimotion

Apache License 2.0
2.07k stars 121 forks source link

A question about train loss #35

Closed cslvjt closed 8 months ago

cslvjt commented 8 months ago

image When I trained on my own dataset, I found that the loss function did not converge, have you encountered this problem?

cslvjt commented 8 months ago

I'm using the training settings you recommended and the video has a total of 61 frames。

cslvjt commented 8 months ago

Another question about num_pts. What's the point of the num_pts? Thank you.

qianqianwang68 commented 8 months ago

Since we used a hard negative mining strategy that samples points with high errors periodically, it is normal for the loss to increase. But it should be decreasing in each [n20k, (n+1)20k] interval. Because you applied strong smoothing I cannot tell if this is true. I suggest also looking at the intermediate visualizations that are saved to have a better sense.

num_pts is the number of point correspondences that we sample for each pair of images in each training batch.

cslvjt commented 8 months ago

Thank you!