Feature Request: New server UI from llama.cpp - Githubissues

Mozilla-Ocho / llamafile

Distribute and run LLMs with a single file.

https://llamafile.ai

Other

16.75k stars 830 forks source link

Feature Request: New server UI from llama.cpp #470

Closed AmgadHasan closed 2 weeks ago

AmgadHasan commented 2 weeks ago

Prerequisites

[X] I am running the latest code. Mention the version if possible as well.
[X] I carefully followed the README.md.
[X] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
[X] I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

Hi I opened this issue to track incorporating the new UI that was recently integrated to llama.cpp https://github.com/ggerganov/llama.cpp/pull/7633

Please let me know when this UI is available on llamafile server.

Motivation

Want a better UI

Possible Implementation

Copy from llama.cpp? Also, add a section in the readme to announce the new UI

jart commented 2 weeks ago

We haven't used the llama.cpp server in a while, since they dropped support for uploading images. We have our own plans for the server and they start at https://github.com/Mozilla-Ocho/llamafile/tree/main/llamafile/server