swj0419 / in-context-pretraining

40 stars 3 forks source link

could you give a lownload link of your iclm data ? #4

Open DavideHe opened 9 months ago

DavideHe commented 9 months ago

as your code, I processed my data of en_commoncrawl . But I was not able to get the result of iclm loss (1.5 with 300B) ;but just decrease 5% only relatively the baseline . could you give a lownload link of your iclm data? thanks a lot !