search

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.01k stars 1.33k forks source link

feat: Local API server - Local API server start based on model engine #3379

Closed Van-QA closed 2 months ago

Van-QA commented 2 months ago
Van-QA commented 2 months ago

Tested and looking good in Jan 0.5.2-619

Van-QA commented 2 months ago

Jan 0.5.3 is released to stable version of Jan app: https://github.com/janhq/jan/releases/tag/v0.5.3, feel free to get back to us if any concern