search

keras-team / keras-nlp

Modular Natural Language Processing workflows with Keras
Apache License 2.0
738 stars 216 forks source link

Add `Falcon` Model #1372

Open SamanehSaadat opened 7 months ago

SamanehSaadat commented 7 months ago

Falcon is a family of language models created by the Technology Innovation Institute (TII). Falcon family has multiple base models: Falcon-180b, Falcon-40B, Falcon-7B, and Falcon-rw-1b. Instruction tuned version of some of the models is available as well: Falcon-7B-Instruct and Falcon-40B-Instruct. Since this is a high quality model, it would be a good addition to the collection of KerasNLP models. I will be working on adding this model.

The following components should be implemented:

simeetnayan81 commented 6 months ago

Hi @SamanehSaadat. This seems a good enhancement project and I would also like to collaborate with you on this.

SamanehSaadat commented 6 months ago

Hi @simeetnayan81! Thanks for your interest in this project. We appreciate you offering to collaborate. The scope of this project is pretty small and I'm handling it for now. But I'll definitely reach out if we need your help. If you're interested in contributing to Keras, please take a look at issues with contributions-welcome label.