I'm running LM Studio, and while the interface looks great, I'm noticing it only seems to support very tiny models. My server has two 3090s, so I can run 70-72b sized models, but the largest listed in LM Studio appears to be InternLM 2.5 20B. Even the LLMs that have large 72b versions, like Qwen2.5-VL, only list the small ~2b models.
Is this a limitation of LM Studio, or is there some configuration I have to set to enable the larger models?
I'm running LM Studio, and while the interface looks great, I'm noticing it only seems to support very tiny models. My server has two 3090s, so I can run 70-72b sized models, but the largest listed in LM Studio appears to be InternLM 2.5 20B. Even the LLMs that have large 72b versions, like Qwen2.5-VL, only list the small ~2b models.
Is this a limitation of LM Studio, or is there some configuration I have to set to enable the larger models?