search

distantmagic / paddler

Stateful load balancer custom-tailored for llama.cpp 🏓🦙
MIT License
632 stars 27 forks source link

adding endpoint for displaying registered agents status #21

Closed Propfend closed 2 months ago