glai - GGUF LLAMA AI - Package for simplified model handling and text generation with Llama models quantized to GGUF format. APIs for downloading and loading models automatically, includes a db with models of various scale and quantizations. With this high level API you need one line to load the model and one to generate text completions.
It appears most models are fine tuned to receiver their assistant tag with the prompt, would like some input.
For models that don't have assistant tags they're set to empty string anyway so including those doesn't cause any issues.