Closed cairocoder closed 1 month ago
I have the same issue
Try changing it to this:
import guidance from guidance import models
mname = "meta-llama/Llama-2-7b-chat-hf" guidance.llm = models.Transformers(mname, device="mps", caching=False, temperature=0.5)
Fixed at v2, no Python needed anymore
which version of guidance you have ? I guess it has developed and changed its API.
I actually dropped guidance (and python) in v2, I'm now using gbnf grammars to force a specific output instead of using Guidance.
When I run below:
npm start -- --local -o unminified.js app.min.js
I got an error: AttributeError: module 'guidance' has no attribute 'llms'. Did you mean: 'llm'?Here's the full terminal output: