issues
search
InftyAI
/
llmaz
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
31
stars
10
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Support ObjectStore as another datasource
#60
kerthcet
closed
3 months ago
1
Support speculative decoding
#59
kerthcet
closed
2 months ago
3
Model version management
#58
kerthcet
opened
3 months ago
2
Add baseline for tests
#57
kerthcet
closed
3 months ago
1
merge once tests passed
#56
kerthcet
closed
3 months ago
32
Add golang ci test
#55
kerthcet
closed
3 months ago
2
Bump github.com/onsi/gomega from 1.33.1 to 1.34.1
#54
dependabot[bot]
closed
3 months ago
3
Bump github.com/onsi/ginkgo/v2 from 2.19.0 to 2.19.1
#53
dependabot[bot]
closed
3 months ago
1
Bump the kubernetes group with 5 updates
#52
dependabot[bot]
closed
3 months ago
1
Add dependabot and issue & pr template
#51
kerthcet
closed
3 months ago
2
Concurrently download the main container image when downloading weights
#50
kerthcet
opened
3 months ago
3
Update docs of examples
#49
kerthcet
closed
3 months ago
1
Add new datasource interface
#48
kerthcet
closed
3 months ago
2
Support loading models from Image volume source
#47
kerthcet
closed
3 months ago
4
Feat: support sglang backend
#46
vicoooo26
closed
3 months ago
9
Feat: support modelscope
#45
vicoooo26
closed
3 months ago
4
CI support for tests
#44
kerthcet
closed
3 months ago
1
Use modelHub as one data source
#43
kerthcet
closed
3 months ago
1
Install lws at llmaz-system namespace
#42
kerthcet
opened
3 months ago
3
Add support for multithread when downloading weights
#41
kerthcet
closed
3 months ago
2
Use rust instead of python to download model weights
#40
kerthcet
closed
3 months ago
2
Support SGLang as another backend
#39
kerthcet
closed
3 months ago
2
Use rust instead of python when downloading model weights
#38
kerthcet
closed
3 months ago
6
Support OpenAPI
#37
kerthcet
opened
4 months ago
5
Update README.md to avoid confusion
#36
kerthcet
closed
4 months ago
1
Support OCI artifacts
#35
kerthcet
opened
4 months ago
3
Will sharing models via hostPath leading to security probelm
#34
kerthcet
opened
4 months ago
11
Model should be namespaced
#33
kerthcet
closed
3 months ago
1
Support Deployment for serving most models
#32
kerthcet
opened
4 months ago
9
Chore: fix readme typos
#31
kerthcet
closed
4 months ago
2
Release v0.0.1
#30
kerthcet
closed
4 months ago
1
Support loading model from huggingface
#29
kerthcet
closed
4 months ago
3
[2/N] Add support for single host deployment
#28
kerthcet
closed
4 months ago
2
Lora multiplexing support
#27
kerthcet
opened
4 months ago
4
Failed to patch inferenceService because of schema undeclared
#26
kerthcet
closed
4 months ago
3
[1/N] Add support for per model deployment
#25
kerthcet
closed
4 months ago
2
Remove `core` folder
#24
kerthcet
opened
4 months ago
3
Support HA with LeaderElection
#23
kerthcet
closed
2 months ago
5
Support Secret in Playground
#22
kerthcet
closed
3 months ago
3
Liveness & Readiness support
#21
kerthcet
opened
4 months ago
3
Support DataSource of docker image
#20
kerthcet
closed
2 months ago
5
Support DataSource of ModelScope
#19
kerthcet
closed
3 months ago
2
Support DataSource of Huggingface
#18
kerthcet
closed
4 months ago
1
Add more testcases for webhooks
#17
kerthcet
opened
4 months ago
5
Support multi-host inference
#16
kerthcet
opened
4 months ago
1
Support splitwise with multiModelsClaims
#15
kerthcet
opened
4 months ago
2
Failed to pass through the labels to the lws Pods
#14
kerthcet
closed
3 months ago
3
Add webhook to Playground
#13
kerthcet
closed
4 months ago
1
Add E2E test framework
#12
kerthcet
closed
4 months ago
1
Add webhook to Model
#11
kerthcet
closed
4 months ago
2
Previous
Next