-
### Have you searched for similar requests?
Yes
### Is your feature request related to a problem? If so, please describe.
The author has provided the Dockerfile and docker-compose file in the GitHu…
-
I recently installed the extras API according to the install instructions on the readme. I am running the application in an Ubuntu VM with 12 cores and 24GB RAM.
The server file runs without errors…
Yo1up updated
6 months ago
-
I have over the last months a problem that appears from time to time, more or less often, but always after the context history got on its limits. I always thought that it would be an LLM issue until I…
-
Hello. Is it possible to use container with extras on m2 mac? I'm not sure because dockerfile has:
`FROM nvidia/cuda:11.7.1-cudnn8-runtime-ubuntu20.04`
And also in guide for local install I see th…
-
### Describe the bug
llama.cpp models always gives exactly the same output (compared in winmerge to be sure), like they ignore any sampling options and seed. Sometimes the first output after loadin…
-
### Environment
Self-Hosted (Bare Metal)
### System
Debian 12
### Version
1.11.6
### Desktop Information
Node.js v18.19.0
Release branch.
I don't get far enough for APIs or models to be relev…
-
[LiteLLM Maintainer]
Hi Charles,
Thanks for starring LiteLLM on github (https://github.com/BerriAI/litellm). Do you call multiple LLMs in prod?
-
### Environment
🪟 Windows
### System
windows 10, Microsoft Edge
### Version
1.12.0
### Desktop Information
_No response_
### Describe the problem
The Default_Comfy_Workflow.json is missing th…
-
Wondering if apart from cards it would be possible to load JSON files with world info or Lore books so when they're mentioned it just adds their context, like it is in KooldAI, SillyTavern and such, s…
-
### Environment
Self-Hosted (Bare Metal)
### System
Brave 1.57.64, Ubuntu 23.04
### Version
SillyTavern 1.10.6 'staging' (59af85ce)
### Desktop Information
- Node.js version (if a…