chart or logs of pre-training stage

zengyan-97 / CCLM

Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))

BSD 3-Clause "New" or "Revised" License

87 stars 9 forks source link

chart or logs of pre-training stage #18

Open naot97 opened 1 year ago

naot97 commented 1 year ago

Hi,

I'm retraining pre-training step with some changes, but my loss result still wasn't reduce in second epoch. I wonder mistakes is my code or not. Can you share the chart or log of you pre training. Thanks.