lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
10 stars 3 forks source link

Support for Custom llama.cpp Models and Parameter Configuration #155

Open in0vik opened 1 month ago

in0vik commented 1 month ago

Hello LM Studio Team,

I would like to request a feature that would enhance flexibility for users who utilize llama.cpp models. Specifically, it would be very useful to:

  1. Add Custom llama.cpp Models: Enable users to import and manage their own custom llama.cpp models directly within LM Studio, expanding beyond the default model library.
  2. Pass Through Parameters: Allow configuration for all possible llama.cpp parameters. For instance, users could set options such as --grammar and other parameters directly within the LM Studio interface or configuration files. This would grant more control over model behavior, making it adaptable to a wide range of custom use cases.