search

keldenl / gpt-llama.cpp

A llama.cpp drop-in replacement for OpenAI's GPT endpoints, allowing GPT-powered apps to run off local llama.cpp models instead of OpenAI.
MIT License
594 stars 67 forks source link

run with llama_index #36

Open shengkaixuan opened 1 year ago

shengkaixuan commented 1 year ago

can gpt-llama.cpp run with https://github.com/jerryjliu/llama_index

keldenl commented 1 year ago

it can run with langchain (added support for it a couple days ago), so i'm assuming so too – let me see if i can get it working

afbenevides commented 1 year ago

Do you have an example available with llama_index embeddings? It would be of interest here too. Thanks!