search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.82k stars 1.39k forks source link

bug: Cannot use models outside the list #4028

Open lv333ming opened 1 week ago

lv333ming commented 1 week ago

Jan version

0.5.8

Describe the Bug

Models not in the list cannot be displayed on my model. That is to say, I can only use the models in the list and cannot use third-party models on jan.

Steps to Reproduce

No response

Screenshots / Logs

No response

What is your OS?

louis-jan commented 1 week ago

Discussion here: There are a couple of cases in the discussion:

  1. Importing a multipart GGUF model which is not supported
  2. Mismatch folder name and model id here https://github.com/janhq/jan/issues/4015 https://discord.com/channels/1107178041848909847/1149558035971321886/1307199735840378971

It’s now displayed on the model list, to confirm that is correct? @lv333ming

imtuyethan commented 1 week ago

Hi @lv333ming, thanks for spending time reporting. Quick follow-up questions to help us better debug your issue:

  1. Can you share an example of a model not showing up on your list? Specifically:
    • What's the model name/type? It is possibly better to send us the model link.
    • Where did you download it from? Did you try to manually import it? How did you do so?

Let me know these details and we'll help get this sorted 👍

imtuyethan commented 2 days ago

That PR is not related @urmauur