search

mlc-ai / web-llm-chat

Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
https://chat.webllm.ai/
Apache License 2.0
380 stars 58 forks source link

[Feature Request]: Integrate into MLC CLI #21

Closed Neet-Nestor closed 4 months ago

Neet-Nestor commented 5 months ago

Problem Description

https://github.com/mlc-ai/mlc-llm

Solution Description

The CLI needs to integrate with this chat UI through local API endpoints.

mlc_llm serve hf://mlc-ai/model --web-ui

Alternatives Considered

No response

Additional Context

No response