search

keras-team / keras-hub

Pretrained model hub for Keras 3
Apache License 2.0
804 stars 243 forks source link

Port albert transformer checkpoint #1767

Closed cosmo3769 closed 3 months ago

cosmo3769 commented 3 months ago

Hi @mattdangerw @ariG23498,

Ported albert transformers checkpoint in kerasNLP. Please check. Thank you!

mattdangerw commented 3 months ago

This looks good to me! I pushed some formatting fixes to limit line length, but will pull this in.

mattdangerw commented 3 months ago

Here's a colab to test encoder style checkpoints like this if it's helpful https://colab.research.google.com/gist/mattdangerw/a1fedc952d28c8395021a94b77e75872/albert-test.ipynb