allow installation of onprem without llama-cpp-python for easier use with LLMs served through REST APIs - Githubissues

amaiya / onprem

A tool for running on-premises large language models with non-public data

https://amaiya.github.io/onprem

Apache License 2.0

684 stars 32 forks source link

allow installation of onprem without llama-cpp-python for easier use with LLMs served through REST APIs #62

Closed amaiya closed 3 months ago