issues
search
distantmagic
/
paddler
Stateful load balancer custom-tailored for llama.cpp 🏓🦙
MIT License
630
stars
27
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
chore(deps): bump rustls from 0.23.17 to 0.23.18
#30
dependabot[bot]
closed
1 week ago
0
making Makefile work for windows.
#29
Propfend
closed
1 week ago
0
Enable Link-Time Optimization (LTO)
#28
zamazan4ik
closed
1 week ago
1
Making the Make(pun)file work for windows.
#27
Propfend
closed
1 week ago
0
Fix typo with registered_targets
#26
lukebelbina
closed
4 weeks ago
1
Balancer not listening in configured port
#25
Luirl
closed
1 week ago
1
--reverseproxy-port and --rewrite-host-header option are not working
#24
Luirl
closed
1 month ago
2
Add support for API-Key protected /slots endpoint introduced in llama.cpp b3898
#23
countzero
closed
1 month ago
1
adding registered agents displaying api endpoint
#22
Propfend
closed
2 months ago
0
adding endpoint for displaying registered agents status
#21
Propfend
closed
2 months ago
0
Paddler balancer sends requests to the external llama.cpp server machine with the wrong HTTP "Host" header
#20
countzero
closed
2 months ago
10
(stastsd) not wokring idle slot with latest llama.cpp
#19
bodybreaker
closed
1 week ago
5
Support OpenAI-style endpoints
#18
mcharytoniuk
closed
1 week ago
0
When will buffer queues be enabled?
#17
bodybreaker
closed
1 week ago
2
Assign names to Paddler agents
#15
mcharytoniuk
closed
3 months ago
0
CORS Issue
#13
bodybreaker
closed
3 months ago
1
Support Docker
#11
bodybreaker
closed
3 months ago
4
Sticky Sessions
#10
mcharytoniuk
opened
3 months ago
3
Is it possible to deploy more than 1 balancer?
#9
wwulfric
closed
3 months ago
3
Req for windows Build
#8
jkfnc
closed
4 months ago
6
Malzag readme update
#7
malzag
closed
5 months ago
1
Explore integration options with Ollama and other backends
#6
mcharytoniuk
opened
6 months ago
5
Support custom AWS CloudWatch metrics through StatsD
#5
mcharytoniuk
closed
5 months ago
0
Tutorial about deploying llama.cpp on AWS EC2 image builder via AWS GUI
#4
malzag
closed
6 months ago
2
Create tutorial-installing-llamacpp-aws-ec2-image-builder.md
#3
mcharytoniuk
closed
6 months ago
0
tutorial on how to install paddler on EC2 alongside llama.cpp
#2
mcharytoniuk
closed
4 months ago
0
add llama.cpp tutorial with some troubleshooting
#1
mcharytoniuk
closed
6 months ago
0