Closed ogabrielluiz closed 10 months ago
Ctransformers allows support for many models in the GGML format and HuggingFace models.
LGTM
It would be great to add (optional) GPU support for LLama models.
Ctransformers allows support for many models in the GGML format and HuggingFace models.