Can we get this to run on OOba 4bit quantized models? - Githubissues

adriacabeza / erudito

Erudito: Easy API/CLI to ask questions about your documentation

https://adriacabeza.github.io/erudito/

101 stars 10 forks source link

Can we get this to run on OOba 4bit quantized models? #2

Open bbecausereasonss opened 1 year ago

bbecausereasonss commented 1 year ago

That would be amazing :)