search

huggingface / hub-docs

Docs of the Hugging Face Hub
http://hf.co/docs/hub
Apache License 2.0
268 stars 229 forks source link

Update the `GGUF usage with llama.cpp` doc page #1277

Open julien-c opened 4 months ago

julien-c commented 4 months ago

there's now way cleaner syntax than https://huggingface.co/docs/hub/en/gguf-llamacpp to load a model from HF in llama.cpp

cakiki commented 2 months ago

This is resolved by https://github.com/huggingface/hub-docs/pull/1280 right?

julien-c commented 2 months ago

hmm no only partly i think

https://huggingface.co/docs/hub/en/gguf-llamacpp is still sub-optimal imo.

cc @Vaibhavs10, and also cc @ngxson who opened https://github.com/huggingface/huggingface.js/pull/778 which is the same command(s) but "in-product" (on the Hub) vs. in a doc

Vaibhavs10 commented 2 months ago

Good catch, will open a PR today to update and ask for everyone's reviews! 👍

Vaibhavs10 commented 2 months ago

Opened a PR to discuss: https://github.com/huggingface/hub-docs/pull/1326

cc: @ngxson - I wasn't able to add you as a reviewer, but please feel free to review