search

MIV-XJTU / ARTrack

Apache License 2.0
228 stars 33 forks source link

In stage 2, training loss is rising #63

Closed yc-cui closed 4 months ago

yc-cui commented 5 months ago

This is the logs for stage 2:

image image

Stage 1 training is normal:

image

I only changed the number of GPUs from 4 to 2.

AlexDotHam commented 5 months ago

The 2 stage training is unstable because the sample of a video sequence may be causes diverse difficulties in training. It is normal if you train more than 5 epochs, the average loss will slowly decrease.

yc-cui commented 5 months ago

OK，I will check the results when training is finished.

AlexDotHam commented 5 months ago

If you need my training log, i am reproduce my base_256_got model, i will release that maybe 2 hours later?

yc-cui commented 5 months ago

If you need my training log, i am reproduce my base_256_got model, i will release that maybe 2 hours later?

That's very kind of you for doing so.