issues
search
substratusai
/
lingo
Lightweight ML model proxy and autoscaler for kubernetes
https://www.substratus.ai
Apache License 2.0
102
stars
6
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Queue placement is not cancelled on request cancellation
#18
nstogner
closed
8 months ago
1
configurable global concurrency default
#17
samos123
closed
8 months ago
0
HA Design
#16
nstogner
closed
7 months ago
1
Integration tests
#15
nstogner
closed
8 months ago
0
Add system tests and scale with larger queue size
#14
samos123
closed
8 months ago
0
Add comments and increase queue size to 100
#13
samos123
closed
8 months ago
0
Configurable concurrency per replica setting
#12
samos123
opened
8 months ago
4
Ensure lingo responds with 429 on queue overflow
#11
nstogner
closed
8 months ago
1
Publish metrics
#10
nstogner
closed
7 months ago
1
Handling stale requests: Cancelling the request never clears up the replica count
#9
samos123
closed
8 months ago
4
Set min/max replicas from annotation
#8
nstogner
closed
8 months ago
0
add create gke cluster script
#7
samos123
closed
9 months ago
0
Configurable max-queue-size
#6
nstogner
closed
8 months ago
1
add /healthz endpoint that responds 200 OK
#5
samos123
closed
6 months ago
2
publish docker image and update README
#4
samos123
closed
9 months ago
0
Model caching
#3
nstogner
opened
9 months ago
5
High Availability
#2
nstogner
closed
8 months ago
0
Configurable min/max replicas
#1
nstogner
closed
8 months ago
0
Previous