huggingface / swift-transformers

Swift Package to implement a transformers-like API in Swift
Apache License 2.0
536 stars 46 forks source link

Tokenizer force unwraps an optional that's nil for Gemma #88

Open ViRo3 opened 2 months ago

ViRo3 commented 2 months ago

st.txt

Steps :

  1. https://github.com/ml-explore/mlx-swift-examples/tree/main/Applications/LLMEval Change LLMEvaluator to use gemma
  2. Prompt : "Write code to boot raspberry pico pi"
  3. Bug

Related : https://github.com/ml-explore/mlx-swift-examples/issues/50

pcuenca commented 2 months ago

Thanks for the report and the extra context, I'll take a look soon!