search

1rgs / jsonformer

A Bulletproof Way to Generate Structured JSON from Language Models
MIT License
4.47k stars 156 forks source link

ctransformers / GGML support #34

Open kw2828 opened 1 year ago

kw2828 commented 1 year ago

hey any chance the team can work to provide ctransformers / GGML support? also key description options would be clutch, thanks

talhalatifkhan commented 1 year ago

any update on this, i need to use this with llama cpp python

mhillebrand commented 1 year ago

And what about GPTQ models?

mhillebrand commented 1 year ago

I just created a PR that allows Jsonformer to work with auto-gptq:

https://github.com/1rgs/jsonformer/pull/36

kaosbeat commented 8 months ago

any update on this, i need to use this with llama cpp python

Where you able to get this working with llama ccp python?

projects-g commented 8 months ago

Need the same. Working with LLama-Cpp python.

Peji-moghimi commented 7 months ago

I also need to use this with LLama-Cpp python.