search

laelhalawani / glai

glai - GGUF LLAMA AI - Package for simplified model handling and text generation with Llama models quantized to GGUF format. APIs for downloading and loading models automatically, includes a db with models of various scale and quantizations. With this high level API you need one line to load the model and one to generate text completions.
https://laelhalawani.github.io/glai/
Other
5 stars 0 forks source link

Add documentation for built in models #23

Closed laelhalawani closed 6 months ago

laelhalawani commented 6 months ago

The ModelDB features information (and ability to download) a few of the verified tested models along with their message format configuration. Overview of the default available models should be included in the documentation.

laelhalawani commented 6 months ago

done in modeldb dedictaed repo GGUF ModelDB has been moved to a dedicated package gguf_modeldb availablen on github and pypi https://github.com/laelhalawani/gguf_modeldb pip install gguf_modeldb>=0.0.1a3