search

amaiya / onprem

A tool for running on-premises large language models with non-public data
https://amaiya.github.io/onprem
Apache License 2.0
684 stars 32 forks source link

GGUF support #27

Closed amaiya closed 11 months ago

amaiya commented 11 months ago

Fixes #1. OnPrem.LLM now uses the newer GGUF format.