`from_preset` issues for huggingface/transformers checkpoint converters

keras-team / keras-hub

Pretrained model hub for Keras 3

Apache License 2.0

804 stars 243 forks source link

`from_preset` issues for huggingface/transformers checkpoint converters #1798

Closed mattdangerw closed 2 months ago

mattdangerw commented 2 months ago

"Auto class" functionality does not work. keras_nlp.models.Backbone("hf://google-bert/bert-base-uncased") will error.
Config overrides do not work. keras_nlp.models.BertBackbone("hf://google-bert/bert-base-uncased", dtype="bfloat16") will not silently ignore the dtype setting.

mattdangerw commented 2 months ago

I also think there's a few places config overrides do not work outside of the transformers converts. E.g. instantiating a full task or preprocessor object.