epic: Jan's Revamped Model Hub

[imtuyethan]

Goals

• [ ] Model hub should have latest models
• [ ] Model hub should have "trending" section from Huggingface (or we curate)
• [ ] Model hub should support Jan's "Built-in Model Repo" format (i.e. tag-based)

Tasklist

• [ ] Integrate new cortex.cpp APIs (i.e. cortex models *)
• [ ] Integrate new Built-in Model Library https://github.com/janhq/models/issues/22
• [ ] llama3-s
• [ ] Nemo
• [ ] Phi3.5
• [ ] GPT o1

Related Issues

• https://github.com/janhq/jan/issues/3251

Original Post

Specs: https://www.notion.so/jan-ai/Hub-revamp-2ae2fdeae6494c87abac65df2da751ba?pvs=4
Figma: https://www.figma.com/design/DYfpMhf8qiSReKvYooBgDV/Jan-App-(3rd-version)?node-id=8003-82567&t=OeIjP9QpatIZiRn1-4

# Objectives
- Simplify the model discovery and installation process
- Integrate the new Cortex engine while hiding legacy models

# Key user stories
- Pull Hugging Face Cortexso hub at build time, each model per engine will be a new item in Jan Hub without grouping
- Distinguish old model + new models in the Hub with label (per engine)
- Model JSON vs YAML:
    - Hugging Face Cortexso hub: YAML => unchanged, Jan app to read data for models (on download) with the same structure as standard Model.json
    - Existing Model.json: unchanged
------
1. Users can browse and search for On-device & Cloud models
2. Users can set up cloud model providers
3. Users can download and use on-device models
4. Users can import Hugging Face model by enter HF model URL
5. Users can view detailed information about each model
6. Users can filter models by type and sort by `popularity` or `newest`
7. Users can track model download progress

![Image](https://github.com/user-attachments/assets/57661c5a-0def-4e28-b22a-e7ffdb878b9b)

[Naith123]

Adding to this, being able to filter results by on-device and cloud models like you can in the model select drop-down would be great.

[imtuyethan]

Once cortex models are populated, we should categorize on-device models to built-in models & HF models:

Key user stories

• Users should be able to differentiate between:
  • Models from Cortex extension (built-in models)
  • Hugging Face models
  • Legacy models (old model run by Nitro extension, populated before Jan v0.6.0)

Figma: https://www.figma.com/design/DYfpMhf8qiSReKvYooBgDV/Jan-App-(3rd-version)?node-id=7480-134479&t=tP4XUtyZk6tTrQHR-4

[imtuyethan]

Related https://github.com/janhq/jan/issues/3656