Closed toby-lm closed 4 months ago
did all in one, dockerfile and runpod both available:
did all in one, dockerfile and runpod both available:
Thanks! I can confirm applying the patches you added in your repo fixed my issues in a remote deployment setting.
If you have a fix we would happily review a PR for it!
Hi, I've experienced a lot of issues trying to get this running locally with docker compose, using a Text Generation Inference API + Model and a mongoDB container.
Errors
Initially I experience issue #252 where the modal cannot be dismissed. When I hardcode
ethicsModalAcceptedAt
to dismiss this, I would get a 500 Error on the /settings page that redirects after accepting the modal. I could navigate to the chat homepage though, but starting a new chat gave me a 403 Forbidden error.After some debugging in the source code, I added this line into the Dockerfile (just before the
rpm run build
command) and I was able to get conversations to work:Disabling the
PUBLIC_APP_DISCLAIMER
then let me access the UI without any visible errors (this was not possible before thesed
command).I'm not familiar enough with Svelte & Typescript to figure out an actual solution for this but this is what I've found. I've confirmed MongoDB access is working and this issue is replicated across Safari, Firefox & Chrome. I'm accessing the chat UI from macOS and it is running on a Linux machine on my local network.
During conversations, the following error will appear in the logs (seems similar to #274) and conversations will not be saved or have any name (but this might be because I've commented out any authCondition call):
Setup
I hope that's an understandable overview of my issues. Here is a minimum reproducible version of my setup:
docker-compose.yml
.env.local
The
Dockerfile
for chat-ui is unchanged apart from the additional line to run thesed
command explained above.If you have a working example of a fully local pipeline with text-generation-inference and mongoDB, preferably in Docker, that would also be super useful. Let me know what other information you need to debug or reproduce this.