search

cztomsik / ava

All-in-one desktop app for running LLMs locally.
https://avapls.com
Other
425 stars 16 forks source link

include size of the files when searching for models to download #22

Open prabirshrestha opened 7 months ago

cztomsik commented 7 months ago

AFAIK it is not part of the huggingface api, what we are calling is this:

https://huggingface.co/api/models?search=gguf&full=true&sort=downloads&direction=-1&limit=15

prabirshrestha commented 7 months ago

Seems like you might need to make another request once the repo is selected with ?blobs=true.

https://github.com/huggingface/huggingface_hub/issues/1158

https://huggingface.co/api/models/TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF?blobs=true.

{
"siblings": [
        {
            "rfilename": ".gitattributes",
            "blobId": "51285d1d0a5e763be7f9756c11fd524b841e3a4d",
            "size": 2109
        },
        {
            "rfilename": "README.md",
            "blobId": "0e4ea04dd8a4df836a2479dda21c05bb0fda3a39",
            "size": 22232
        },
        {
            "rfilename": "config.json",
            "blobId": "c2dc548a36b1b154d6d92107c2ee091dd5b592e4",
            "size": 31
        },
        {
            "rfilename": "mixtral-8x7b-instruct-v0.1.Q2_K.gguf",
            "blobId": "8b30ad5ba1105ce133477e5ef483d9d4eb24ce41",
            "size": 15644035008,
            "lfs": {
                "sha256": "d54b4f4ec06dbae558d25b2d1542417cdf9547907342db85eecd05b6e96e88f8",
                "size": 15644035008,
                "pointerSize": 136
            }
        },
        {
            "rfilename": "mixtral-8x7b-instruct-v0.1.Q3_K_M.gguf",
            "blobId": "9d93cbcee7b597fadb999ebd47b28ee352fc7be5",
            "size": 20363356096,
            "lfs": {
                "sha256": "bd2e1499e68195f1a6ff151e6fa5c6632acc150b80cca4a3772cbb7ca59d44cd",
                "size": 20363356096,
                "pointerSize": 136
            }
        }
]
}
cztomsik commented 7 months ago

Oh, I somehow missed that, this is great, thanks!