search

keras-team / keras-nlp

Modular Natural Language Processing workflows with Keras
Apache License 2.0
740 stars 218 forks source link

Utilities to save and load only tasks weights #1531

Closed mattdangerw closed 3 months ago

mattdangerw commented 3 months ago

Not for merging. A test utility for better handling saving and loading task objects.

In addition to the private H5IOStore (which we rely on for lora), this also relies on _save_state and _load_state. We should probably think of a better contract with core Keras before we ship, but this will allow a prototype.

mattdangerw commented 3 months ago

Closing this, was just fodder for https://github.com/keras-team/keras-nlp/pull/1547