search

keras-team / keras-nlp

Modular Natural Language Processing workflows with Keras
Apache License 2.0
758 stars 227 forks source link

Add `LlamaPreprocessor` and `LlamaCausalLMPreprocessor` #1511

Closed tirthasheshpatel closed 5 months ago

tirthasheshpatel commented 5 months ago

Adds preprocessors for the Llama backbone. Uses the same code as Mistral.