search

keras-team / keras-nlp

Modular Natural Language Processing workflows with Keras
Apache License 2.0
741 stars 219 forks source link

Port LoRA example to multi-backend Keras #1141

Open abheesht17 opened 1 year ago

abheesht17 commented 1 year ago

Example: https://keras.io/examples/nlp/parameter_efficient_finetuning_of_gpt2_with_lora/

LoRA generated outputs are gibberish with multi-precision. Works fine without it.

abheesht17 commented 1 year ago

https://github.com/keras-team/keras-io/pull/1454