closedai-project / closedai

Drop in replacement for OpenAI, but with Open models.
Apache License 2.0
154 stars 8 forks source link

Add llama.cpp example [WIP] #3

Open teddykoker opened 1 year ago

nateraw commented 1 year ago

note for myself: https://huggingface.co/frankenstyle/ggml-q4-models/tree/main/models/llama