lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
8 stars 3 forks source link

Text embedding and LLM categories mixed, models not in correct category #66

Open kauttoj opened 2 months ago

kauttoj commented 2 months ago

See list of my current models in LM Studio. Why are some embedding models included in LLM model category? Which file(s) in LM studio Windows installation I can modify to force a model into specific category? In this case I want to force those two embedding models from LLM to embedding category. image

yagil commented 2 months ago

Thanks @kauttoj these models are llamas (see screenshots) which makes the app categorize them as LLMs. I understand you would like to get embeddings output out of these. Other than the categorization in My Models, do they work as you intend?

image image
Tomixbo commented 1 month ago

I encounter the same problem with : RichardErkhov/Alibaba-NLP_-_gte-Qwen2-7B-instruct-gguf It recognized as LLM instead of an embedding model.

Is there a fix to it?