search

google-research / bert

TensorFlow code and pre-trained models for BERT
https://arxiv.org/abs/1810.04805
Apache License 2.0
37.82k stars 9.56k forks source link

Pre-trained monolingual in French #502

Open Alikabbadj opened 5 years ago

Alikabbadj commented 5 years ago

Is there anywhere a BERT-base monolingual French pre-trained model?

I need it as entry for fine-tuning Question & Answering in French.

Alikabbadj commented 5 years ago

I have a SQuAD v1.1 dataset in French and I want to fine-tune BERT to aswer questions in French

atmani-massinissa commented 5 years ago

Hi Alikabbadj,

I can't help you for the French version of BERT, but there is an apllication of ULMFIT of fast.ai for French : https://github.com/tchambon/deepfrench

Also,could you please tell me where can I find the SQuaD v1.1 in French, or provide me with a link.

Thanks

LisaBanana commented 5 years ago

Hi Alikabbadj,

Did you finally found a french pre trained version of BERT ? I'm actually looking for one for a QA project too ...

Thanks if anyone has an answer :)

Alikabbadj commented 4 years ago

Hi all,

You can get the SQuaD v1.1 in French from https://github.com/Alikabbadj/French-SQuAD/tree/master

ClaudeCoulombe commented 4 years ago

Greetings folks,

From what I know, all the high performance and biggest pre-trained models (GPT, BERT, ...) are in English only (but strangely enough or not in Chinese ?!??!!). There are some multilingual models like multilingual BERT that are quite poor but still usable for French. Infos and download hyperlink at : https://github.com/google-research/bert/blob/master/multilingual.md

Bonne chance!

Alikabbadj commented 4 years ago

Hi Lisa,

You can find SAuAD v1.1 in French here:

https://drive.google.com/drive/folders/1HzvQv4W7sveWkuxbw04tTfgiDq0ZKW8U?usp=sharing

And you can read my paper here:

https://github.com/Alikabbadj/French-SQuAD

Good luck Ali

2019-08-20 15:39 UTC+02:00, LisaBanana notifications@github.com:

Hi Alikabbadj,

Did you finally found a french pre trained version of BERT ? I'm actually looking for one for a QA project too ...

Thanks if anyone has an answer :)

-- You are receiving this because you authored the thread. Reply to this email directly or view it on GitHub: https://github.com/google-research/bert/issues/502#issuecomment-523019154

LisaBanana commented 4 years ago

Thank you very much Ali !

Have a nice day !

Lisa

Le ven. 25 oct. 2019 à 09:22, Ali Kabbadj notifications@github.com a écrit :

Hi Lisa,

You can find SAuAD v1.1 in French here:

https://drive.google.com/drive/folders/1HzvQv4W7sveWkuxbw04tTfgiDq0ZKW8U?usp=sharing

And you can read my paper here:

https://github.com/Alikabbadj/French-SQuAD

Good luck Ali

2019-08-20 15:39 UTC+02:00, LisaBanana notifications@github.com:

Hi Alikabbadj,

Did you finally found a french pre trained version of BERT ? I'm actually looking for one for a QA project too ...

Thanks if anyone has an answer :)

-- You are receiving this because you authored the thread. Reply to this email directly or view it on GitHub:

https://github.com/google-research/bert/issues/502#issuecomment-523019154

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/google-research/bert/issues/502?email_source=notifications&email_token=ALP3CMF4HFIGJ2W2O7SKMU3QQKNEZA5CNFSM4G7E7JG2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOECHOH4Y#issuecomment-546235379, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALP3CMAM7Y3DLHKYBQQ5GFDQQKNEZANCNFSM4G7E7JGQ .

manueltonneau commented 4 years ago

This model called CamemBERT also just came out (https://arxiv.org/abs/1911.03894) and is implemented in the transformers library (https://github.com/huggingface/transformers). :)

LabelleH commented 3 years ago

Hi Ali, Is your version of SQuaD v1.1 in French under any license ? Just curious : I would like to use it on Canadian researches. Thanks, Hélène from Canada

Alikabbadj commented 3 years ago

Hi Hélène,

Yes you can use my SQuaD v1.1 in French without license for research project.

Best regards Ali Kabbadj

Le lun. 8 mars 2021 à 16:09, LabelleH notifications@github.com a écrit :

Hi Ali, Is your version of SQuaD v1.1 in French under any license ? Just curious : I would like to use it on Canadian researches. Thanks, Hélène from Canada

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/google-research/bert/issues/502#issuecomment-792818297, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIDDOOBFBEPBFFE3Q7FTTWLTCTSBLANCNFSM4G7E7JGQ .