Create a chat webapp with elegant UI on mlc.ai

[Neet-Nestor]

Currently, the UI of the Web-LLM demo hosted at webllm.mlc.ai serves its purpose as a basic demonstration. However, to enhance the marketability of the project, it's imperative to elevate the user experience by implementing a more elegant and user-friendly interface.

One effective approach to achieve this is by integrating Web-LLM into an open-source chatbot UI framework. A list of available candidates is Every ChatGPT GUI.

Integrating Web-LLM with a sophisticated chatbot UI not only improves its aesthetics but also enhances its usability and appeal to potential users and stakeholders. This integration will offer a seamless and intuitive interaction experience, contributing significantly to the project's marketability and adoption.

I'm interested in creating one and I'll post my update there in this issue thread.

[Neet-Nestor]

I've developed a web application integrating Web-LLM with NextChat (ChatGPT Next Web).

You can access the live demo at https://chat.neet.coffee/ and here's a screenshot:

Please note that this integration is currently in its preliminary demonstration phase. Further modifications and enhancements are necessary to ensure all functionalities work seamlessly.

Nest steps:

• Resolve the repeated model initialization issue
• Support service-worker
• Support streaming
• Support more customization

[Neet-Nestor]

The chat webapp https://chat.neet.coffee/ has been updated to:

• Resolve the repeated model initialization issue
• Support service-worker
• Support streaming
• Support more customization

As the next step, I will work on optimizing the model management and loading since currently the model loading still takes 20+ seconds with cache and it is required on every page load.

[Neet-Nestor]

Close issue and move tracking to https://github.com/mlc-ai/web-llm-chat

[flatsiedatsie]

It looks fantastic!

// Perhaps it's time for a "projects built with WebLLM" section in the Github readme? It seems https://chat.neet.coffee/ has existed for quite some time. My mind is a little bit blown.

Perhaps of interest: Secret Llama recently created what you describe as well:

https://secretllama.com/

https://github.com/abi/secret-llama

https://www.reddit.com/r/LocalLLaMA/comments/1cjjxc6/i_built_a_free_inbrowser_llm_chatbot_powered_by/

Perhaps it would be an idea to work with that project?

FYI, I will also be releasing a 100% browser-based project soon that heavily builds on WebLLM. It will showcases it's many abilities. Some screenshots:

[Neet-Nestor]

Perhaps of interest: Secret Llama recently created what you describe as well:

https://secretllama.com/

https://github.com/abi/secret-llama

https://www.reddit.com/r/LocalLLaMA/comments/1cjjxc6/i_built_a_free_inbrowser_llm_chatbot_powered_by/

This is interesting and thank you for sharing! The discussion there validates my assumption that a user-friendly, production-ready, streamlined UI for web-llm is expected by many users.

I had a brief look of their codebase, and realized that the author created the project from scratch and the current stage of the webapp UI is still relatively premature. I did it in a different approach by integrating web-llm to a more mature open-source chat UI projects in hope to avoid reinvent the wheels and be able to quickly launch an elegant and user-friendly webapp product to the public.

Therefore, I will continue working on this as a separate project, web-llm-chat, under mlc.ai, but I will try reach out to secret llama's authors for potential collaborations.

FYI, I will also be releasing a 100% browser-based project soon that heavily builds on WebLLM. It will showcases it's many abilities.

Your project looks very cool with a comprehensive set of features. Best luck on it!