Open Exotik850 opened 1 year ago
Hi there! Yes, it's supported, but only on the latest version (main
) - we haven't cut a new release yet. Hope to have that sorted soon!
My apologies, should've tried the main branch instead of just trying the release 😅
No worries - I'll keep this up for now and pin it for people's reference until we get it out the door :)
@philpax have you considered making some 0.2.0-beta.1
etc. releases on crates.io? This pattern has worked very well for some of my own projects in the past.
Hi there! Yeah, I've considered it, but the main blocker is https://github.com/rustformers/llm/issues/221 - I don't want to cut a release where the interface is going to be radically different in the next release. I'm hoping to have this all closed out within the next week or two, especially with GGUF on the horizon, but I've been quite busy.
Tried using the cli application to see how far it had come from being llama-rs, and noticed that an error popped up using one of the newer WizardLM uncensored models using the GGMLv3 method,
Am I using it the wrong way or is it not supported yet?