issues
search
distantmagic
/
paddler
Stateful load balancer custom-tailored for llama.cpp
MIT License
515
stars
22
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
(stastsd) not wokring idle slot with latest llama.cpp
#19
bodybreaker
opened
2 weeks ago
3
Support OpenAI-style endpoints
#18
mcharytoniuk
opened
3 weeks ago
0
When will buffer queues be enabled?
#17
bodybreaker
opened
3 weeks ago
1
Assign names to Paddler agents
#15
mcharytoniuk
closed
1 month ago
0
CORS Issue
#13
bodybreaker
closed
1 month ago
1
Support Docker
#11
bodybreaker
closed
1 month ago
4
Sticky Sessions
#10
mcharytoniuk
opened
1 month ago
0
Is it possible to deploy more than 1 balancer?
#9
wwulfric
closed
1 month ago
3
Req for windows Build
#8
jkfnc
closed
1 month ago
6
Malzag readme update
#7
malzag
closed
3 months ago
1
Explore integration options with Ollama and other backends
#6
mcharytoniuk
opened
3 months ago
5
Support custom AWS CloudWatch metrics through StatsD
#5
mcharytoniuk
closed
2 months ago
0
Tutorial about deploying llama.cpp on AWS EC2 image builder via AWS GUI
#4
malzag
closed
3 months ago
2
Create tutorial-installing-llamacpp-aws-ec2-image-builder.md
#3
mcharytoniuk
closed
3 months ago
0
tutorial on how to install paddler on EC2 alongside llama.cpp
#2
mcharytoniuk
closed
1 month ago
0
add llama.cpp tutorial with some troubleshooting
#1
mcharytoniuk
closed
3 months ago
0