janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
22.01k stars 1.26k forks source link

epic: Jan's Revamped Model Hub #3461

Open imtuyethan opened 2 weeks ago

imtuyethan commented 2 weeks ago

Goals

Tasklist

Related Issues

Original Post

Specs: https://www.notion.so/jan-ai/Hub-revamp-2ae2fdeae6494c87abac65df2da751ba?pvs=4
Figma: https://www.figma.com/design/DYfpMhf8qiSReKvYooBgDV/Jan-App-(3rd-version)?node-id=8003-82567&t=OeIjP9QpatIZiRn1-4

# Objectives
- Simplify the model discovery and installation process
- Integrate the new Cortex engine while hiding legacy models

# Key user stories
- Pull Hugging Face Cortexso hub at build time, each model per engine will be a new item in Jan Hub without grouping
- Distinguish old model + new models in the Hub with label (per engine)
- Model JSON vs YAML:
    - Hugging Face Cortexso hub: YAML => unchanged, Jan app to read data for models (on download) with the same structure as standard Model.json
    - Existing Model.json: unchanged
------
1. Users can browse and search for On-device & Cloud models
2. Users can set up cloud model providers
3. Users can download and use on-device models
4. Users can import Hugging Face model by enter HF model URL
5. Users can view detailed information about each model
6. Users can filter models by type and sort by `popularity` or `newest`
7. Users can track model download progress

![Image](https://github.com/user-attachments/assets/57661c5a-0def-4e28-b22a-e7ffdb878b9b)
Naith123 commented 2 weeks ago

Adding to this, being able to filter results by on-device and cloud models like you can in the model select drop-down would be great. image