elixir-nx / bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)
Apache License 2.0
1.26k stars 90 forks source link

Add support for "google/gemma-7b-it" #357

Closed kurtome closed 4 months ago

kurtome commented 4 months ago

HuggingFace now has the Gemma model: https://huggingface.co/google/gemma-7b-it

Expected

    {:ok, nx_model_info} =
      Bumblebee.load_model({:hf, "google/gemma-7b-it", [auth_token: @hf_token]})

    {:ok, nx_tokenizer} =
      Bumblebee.load_tokenizer({:hf, "google/gemma-7b-it", [auth_token: @hf_token]})

Actual

ArgumentError
could not match the class name "GemmaForCausalLM" to any of the supported models,
please specify the :module and :architecture options
seanmor5 commented 4 months ago

See: #358