search

Separius / BERT-keras

Keras implementation of BERT with pre-trained weights
GNU General Public License v3.0
813 stars 196 forks source link

Using released BERT pre-trained weights #1

Closed astariul closed 5 years ago

astariul commented 5 years ago

Awesome job that you did !

Do you plan implementing the BERT pre-trained weights, now that they are released ?

Separius commented 5 years ago

Yes, hopefully by the end of the day it will be ready, you can check the progress (and help) in "Import" branch of the code. I was able to load the weights (Bert uses an extra layer norm, so I had to add it) but currently the results are different and I didn't dig deep into it, I will do it as soon as possible

On Thu, Nov 1, 2018, 4:40 AM Colanim <notifications@github.com wrote:

Awesome job that you did !

Do you plan implementing the BERT pre-trained weights, now that they are released ?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/Separius/BERT-keras/issues/1, or mute the thread https://github.com/notifications/unsubscribe-auth/AAfsCQElUgYXU5PKvl85CuVMQ4Q_8wZwks5uqkL1gaJpZM4YFlsu .

astariul commented 5 years ago

Amazing !

I will take a look as soon as possible, thanks for the direction

Separius commented 5 years ago

You can now import the pretrained models into this library (theano is not working, I will try to fix it as soon as possible)