A collection of standardized JSON descriptors for Large Language Model (LLM) model files.
<model_name>.json
A single JSON file describes a model, its authors, additional resources (such as an academic paper) as well as available model files and their providers.
Version 0.0.1
of this format attempts to capture an informative set of factors including:
7B
, 13B
, 30B
, etc.)Llama
, MPT
, Pythia
, etc.)ggml
) as well as quantization format (e.g. q4_0
, q4_K_M
, etc.)See examples: guanaco-7b.json
, samantha-1.1-llama-7b.json
, Nous-Hermes-13b.json
.
catalog.json
A Github action picks up .json
files from the models/
directory and merges them into one catalog.json
file.
The contents of each JSON file is validated by another Github action using a JSON schema.
You're invited to help catalog models and improve upon this description format.
models/
directory.validate.py
tool or by running createCatalog.py
.Note: Do not modify catalog.json
manually.