search

owj0421 / OutfitTransformer

Implementation of "Outfit Transformer:Outfit Representations for Fashion Recommendation"
Apache License 2.0
31 stars 9 forks source link

acc is always about 0.5 when training cp task #3

Open likeucode opened 8 months ago

likeucode commented 8 months ago

Hi, the acc is always about 0.5 and there is no decline in training losses when i try to train a cp model. Has anything like that ever happened to you?

owj0421 commented 8 months ago

That's one of the reasons I posted Checkpoint. Maybe it's because of Plateu phenomenon, after 2-3 hours of vibration, loss starts to converge. For mitigation, I tried to make warm-up schedulers, optimizer changes, and so on and I was able to improve.

owj0421 commented 8 months ago

I've committed the refactored code to train CP, FITB task model. I haven't tested it because I don't have GPU yet, but I've done some optimization that I didn't have before, so I think there will be an improvement if you use it.

likeucode commented 8 months ago

Thank you for your prompt reply, i will try it, thx~

owj0421 commented 7 months ago

I checked my wandb and found this log! Hope this will help you.

owj0421 commented 7 months ago

W B Chart 2024 2 27 오전 12_06_27

owj0421 commented 4 months ago

After modifying the code, I updated the required checkpoints for CP and CIR. We ask for your interest!

zztMermory commented 4 months ago

W B Chart 2024 2 27 오전 12_06_27

Hi ~ How many epoches had you ever trained?