lmstudio-ai / configs

LM Studio JSON configuration file format and a collection of example config files.
MIT License
186 stars 34 forks source link

I downloaded gguf file manually, how can i add it to LM studio? #11

Open dreambit opened 9 months ago

dreambit commented 9 months ago

I downloaded the gguf file manually; how can I add it to LM studio? I added it to folder, but i have You have 1 uncategorized model files

image
JammersUK commented 9 months ago

I think it's because you're not using the required directory structure. If you have downloaded the model "DiscoLM_German_7b_v1-GGUF" by TheBloke via Huggingface, then the directory structure is: "TheBloke/DiscoLM_German_7b_v1-GGUF/", so the creator as the first directory in the models folder, then the models name as a folder, then the model is in that folder. I hope that makes sense.

Iory1998 commented 5 months ago

You can just set a folder named "model" anywhere you want, manually download models and put them in that folder. I always download models using Internet Download Manager since I like to control the speed of the download.

Below is a screenshot of how I achieved that: image

danpe commented 3 months ago

@JammersUK What is if its a model that didn't come from hugging face?

thewriteway commented 1 month ago

You can just set a folder named "model" anywhere you want, manually download models and put them in that folder. I always download models using Internet Download Manager since I like to control the speed of the download.

lory1198's solution worked for me.

I opened LM studio's storage location. Made a subdirectory called models, another below it called Llama. Moved all my GGUF files there with corresponding folder names.

Opened LM and did a model re-index. They were all then available for use.

Alternatively you can use the built in model import tool CLI wizard from LM studio. It can be found in your LM studio installation directory for example: AppData\Local\LM-Studio\app-0.3.2\resources\app.webpack Just run "lms.exe" and point it to your GGUF