helboukkouri / character-bert

Main repository for "CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary Representations From Characters"
Apache License 2.0
196 stars 46 forks source link

How do I pre-train CharacterBERT? #4

Closed gianfilippo closed 3 years ago

gianfilippo commented 3 years ago

Hi,

can you please share the code/tutorial to train from scratch ?

Thanks

gianfilippo commented 3 years ago

Hi,

thanks I notice that already, but it takes to an almost empty folder.

Best Gianfilippo

On Sat, Jan 9, 2021 at 6:25 AM Gaël de Chalendar notifications@github.com wrote:

Does this answer your question?

https://github.com/helboukkouri/character-bert#how-do-i-pre-train-characterbert

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/helboukkouri/character-bert/issues/4#issuecomment-757135322, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACPSFVAGCGTJS4P7HBU63GTSZA4MLANCNFSM4V3H7GPQ .

helboukkouri commented 3 years ago

Hi @gianfilippo, I am currently working on cleaning up and making the pre-training code a bit easier tu use. That is the reason why it is not yet public. I will post a message on this issue as soon as it is.

Thank you for your interest 😊

helboukkouri commented 3 years ago

The code for pre-training CharacterBERT is now available at: https://github.com/helboukkouri/character-bert-pretraining

Hope you will find it useful 😊

gianfilippo commented 3 years ago

Thanks! I will look into it right away.

On Thu, Feb 25, 2021 at 3:42 AM Hicham EL BOUKKOURI < notifications@github.com> wrote:

The code for pre-training CharacterBERT is now available at: https://github.com/helboukkouri/character-bert-pretraining

Hope you will find it useful 😊

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/helboukkouri/character-bert/issues/4#issuecomment-785723458, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACPSFVHV4AZ2QFL65RDR2PDTAYERHANCNFSM4V3H7GPQ .