search

lmstudio-ai / configs

LM Studio JSON configuration file format and a collection of example config files.
MIT License
172 stars 26 forks source link

I downloaded gguf file manually, how can i add it to LM studio? #11

Open dreambit opened 5 months ago

dreambit commented 5 months ago

I downloaded the gguf file manually; how can I add it to LM studio? I added it to folder, but i have You have 1 uncategorized model files

image
JammersUK commented 5 months ago

I think it's because you're not using the required directory structure. If you have downloaded the model "DiscoLM_German_7b_v1-GGUF" by TheBloke via Huggingface, then the directory structure is: "TheBloke/DiscoLM_German_7b_v1-GGUF/", so the creator as the first directory in the models folder, then the models name as a folder, then the model is in that folder. I hope that makes sense.

Iory1998 commented 1 month ago

You can just set a folder named "model" anywhere you want, manually download models and put them in that folder. I always download models using Internet Download Manager since I like to control the speed of the download.

Below is a screenshot of how I achieved that: image