search

maiqingqiang / ChatMLX

🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
Apache License 2.0
567 stars 34 forks source link

[Feature Request] Add models from file path and allow adapters #6

Open jameshgrn opened 1 week ago

jameshgrn commented 1 week ago

Hi,

great work on this project, the MLX community deserves a nice chat interface like this. So thank you!

A couple ideas just to consider:

  1. As the title says, it would be great to be able to point ChatMLX to already downloaded models. For instance, I have downloaded a bunch of models for other projects, so would be nice to re use those models instead of downloading new ones. When I press the folder button on the models page, nothing happens, so maybe this functionality already exists and the button just doesnt route to anywhere.

  2. Similarly, would be nice to be able to supply an adapters folder for these models. When I'm finetuning, I'd like to be able to test out different adapters without fusing the model to test it out.

Again, these are quality of life features, and I'm sure your priority list is large right now!

Thanks for this again, great project.

maiqingqiang commented 1 week ago

Thank you for your suggestions. I will adopt them.