search

laelhalawani / glai

glai - GGUF LLAMA AI - Package for simplified model handling and text generation with Llama models quantized to GGUF format. APIs for downloading and loading models automatically, includes a db with models of various scale and quantizations. With this high level API you need one line to load the model and one to generate text completions.
https://laelhalawani.github.io/glai/
Other
5 stars 0 forks source link

Add documentation for built in models #23

Closed laelhalawani closed 10 months ago

laelhalawani commented 10 months ago

The ModelDB features information (and ability to download) a few of the verified tested models along with their message format configuration. Overview of the default available models should be included in the documentation.

laelhalawani commented 10 months ago

done in modeldb dedictaed repo GGUF ModelDB has been moved to a dedicated package gguf_modeldb availablen on github and pypi https://github.com/laelhalawani/gguf_modeldb pip install gguf_modeldb>=0.0.1a3