search

google-research / albert

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
Apache License 2.0
3.22k stars 572 forks source link

Multilingual Albert #5

Open haimco10 opened 4 years ago

haimco10 commented 4 years ago

Is there a plan to release multilingual pre-trained model like you did in BERT?

Danny-Google commented 4 years ago

Yes, we do. Please stay tuned

veqtor commented 4 years ago

Really looking forward to this!

Danny-Google commented 4 years ago

Thanks, we are working on it now

r-wheeler commented 4 years ago

Looking forward to this as well.

harrisonford commented 4 years ago

Bump for the spanish tuning.

peregilk commented 4 years ago

Do you have any timeframe for the release of multilingual Albert weights?

zhuolinumd commented 4 years ago

We are waiting for the multilingual ALBERT. Any plans? Thanks.

maxbaluev commented 4 years ago

Any updates?

0x0539 commented 4 years ago

We are actively working on this. I'll post back to this thread when we have some news to share.

zhuolinumd commented 4 years ago

Are there any targeted dates to release the model? Thanks.

r-wheeler commented 4 years ago

@0x0539 Any updates here?

planicka commented 4 years ago

It looks like it's not going well - see https://github.com/google-research/ALBERT/pull/152/files.

peregilk commented 4 years ago

@0x0539 Any chance you can give an update on this? Is it worth waiting for a multilingual Albert?

AminTaheri23 commented 4 years ago

Is there a need for help? Maybe we can offer some.

steindor commented 3 years ago

Any updates on this?

xpatronum commented 3 years ago

@0x0539 After almost one and a half year ago, can we expect in any near future to get multilingual albert?

tgsmith61591 commented 2 years ago

Any update on this?

hyzhan commented 4 months ago

Looking forward to a pre-trained multilingual Albert as well.