nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://nomic.ai/gpt4all
MIT License
70.67k stars 7.7k forks source link

[Feature] [BUG] order of the models and no search option #2963

Open kalle07 opened 1 month ago

kalle07 commented 1 month ago

Feature Request

Hello guys and girls ... 90% of all users have Windows and Windows does not know the difference between upper and lower case letters all models are as at the beginning of GPT4all and since 3 requests still sorted first by capital letters A-Z and then by lower case letters a-z. very impractical!

and second no search option, I have to go through all 200 models until I find the right one.

brankoradovanovic-mcom commented 1 month ago

+1 for a case-insensitive sort in the model drop down on both Linux and Windows.

E.g. I've got Starling alpha and Starling beta but with different case filenames - by chance, that's how the GGUFs got named on HF. Whether it's Linux or Windows, it doesn't make sense to display one model near the top and the other near the bottom of the list just because one filename begins with "S" and the other with "s".

SINAPSA-IC commented 1 month ago

"as at the beginning" this is not the first time this Issue is raised in like half a year. bug? no.

kalle07 commented 1 month ago

so if its not the first time ... all want it for me it is a bug ^^

brankoradovanovic-mcom commented 1 month ago

True, this may not be a bug, but it's not good behavior either. The user has to hunt the model in the drop down list based on the knowledge of whether the filename begins with e.g. "S" or "s". That's not how applications usually work. It becomes really grating for everyday use with e.g. 30+ models (I can only imagine how terrible it must be with 200 models, as described 😄). Also, it would be very easy to fix (by case-insensitive sort).

Searching the list would be nice to have, this is an actual enhancement.

kalle07 commented 1 month ago

and i mean you do that maybe in free time but i think you program it in phyton and its soooooooo EASY to copy and paste it from FREE progammers https://github.com/oobabooga/text-generation-webui

SINAPSA-IC commented 1 month ago

Not in the free time, but while on payroll, so "free" is on the users' end. Some ppl, users too, but manifesting personality disorders (sociopathy, chutzpah), even say to the user raising an Issue, It is a Free program, so you should be thankful and stfu.

Harvester62 commented 3 weeks ago

Since here is an already opened bug report (Enhancement), I prefer to attach my comments here.

I wish to suggest to enhance the locally installed models' ordering option in GPT4All so "To be able to choose by which criteria the Models list should be ordered in the UI".

The file in charge of this is the models.json, inside the folder C:\Users\USERNAME\AppData\Local\nomic.ai\GPT4All\cache. Examining its content, it is clear that the listing order is determined only by the field named "order", as per the first model example below:

""" [ { "order": "a", "md5sum": "c87ad09e1e4c8f9c35a5fcef52b6f1c9", "name": "Llama 3 8B Instruct", "filename": "Meta-Llama-3-8B-Instruct.Q4_0.gguf", "filesize": "4661724384", "requires": "2.7.1", "ramrequired": "8", "parameters": "8 billion", "quant": "q4_0", "type": "LLaMA3", "description": "

", "url": "https://gpt4all.io/models/gguf/Meta-Llama-3-8B-Instruct.Q4_0.gguf", "promptTemplate": "<|start_header_id|>user<|end_header_id|>\n\n%1<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n%2<|eot_id|>", "systemPrompt": "" }, { "order": "b", ... ETCETERA """

I don't know how such ordering is established, but it is not very useful. Wouldn't it be better to order the list of (locally installed) models by the field "name" instead, alphabetically, which the user has control over, being able to change the model's name in the settings? Eventually, such an option might be added in the general application settings.