issues
search
bentoml
/
OpenLLM
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
10.11k
stars
640
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
feat(models): command-r
#1005
aarnphm
closed
5 months ago
0
feat(API): add light support for batch inference
#1004
aarnphm
closed
5 months ago
0
feat: support enforce_eager option from cli
#1003
ADcorpo
closed
4 months ago
1
ci: pre-commit autoupdate [pre-commit.ci]
#1002
pre-commit-ci[bot]
closed
6 months ago
0
chore(deps): bump actions/setup-python from 4.7.1 to 5.1.0
#1001
dependabot[bot]
closed
6 months ago
1
chore(deps): bump taiki-e/install-action from 2.33.22 to 2.33.34
#1000
dependabot[bot]
closed
6 months ago
0
chore(deps): bump actions/download-artifact from 3.0.2 to 4.1.7
#999
dependabot[bot]
closed
6 months ago
1
feat(ci): running CI on paperspace
#998
aarnphm
closed
6 months ago
0
chore(qol): update CLI options and performance upgrade for build cache
#997
aarnphm
closed
6 months ago
0
infra: prepare 0.5 releases
#996
aarnphm
closed
6 months ago
0
fix(docs): update correct BentoML links
#995
dennisrall
closed
6 months ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#994
pre-commit-ci[bot]
closed
6 months ago
0
chore(deps): bump actions/checkout from 4.1.5 to 4.1.6
#993
dependabot[bot]
closed
6 months ago
0
chore(deps): bump github/codeql-action from 3.25.3 to 3.25.5
#992
dependabot[bot]
closed
6 months ago
0
chore(deps): bump aquasecurity/trivy-action from 0.19.0 to 0.20.0
#991
dependabot[bot]
closed
6 months ago
0
chore(deps): bump actions/download-artifact from 3.0.2 to 4.1.7
#990
dependabot[bot]
closed
6 months ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#989
pre-commit-ci[bot]
closed
6 months ago
0
chore(deps): bump rlespinasse/github-slug-action from 4.4.1 to 4.5.0
#988
dependabot[bot]
closed
6 months ago
0
chore(deps): bump softprops/action-gh-release from 1 to 2
#987
dependabot[bot]
closed
6 months ago
0
chore(deps): bump actions/upload-artifact from 3.1.3 to 4.3.3
#986
dependabot[bot]
closed
6 months ago
0
chore(deps): bump taiki-e/install-action from 2.33.9 to 2.33.22
#985
dependabot[bot]
closed
6 months ago
0
chore(deps): bump actions/checkout from 4.1.1 to 4.1.5
#984
dependabot[bot]
closed
6 months ago
0
chore(deps): bump next from 13.4.8 to 14.1.1
#983
dependabot[bot]
closed
6 months ago
0
tests: add additional basic testing
#982
aarnphm
closed
6 months ago
0
fix: make sure to respect additional parameters parse
#981
aarnphm
closed
6 months ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#980
pre-commit-ci[bot]
closed
6 months ago
0
chore(deps): bump docker/build-push-action from 5.1.0 to 5.3.0
#979
dependabot[bot]
closed
6 months ago
0
chore(deps): bump docker/login-action from 3.0.0 to 3.1.0
#978
dependabot[bot]
closed
6 months ago
0
chore(deps): bump github/codeql-action from 3.24.9 to 3.25.3
#977
dependabot[bot]
closed
6 months ago
0
chore(deps): bump peter-evans/create-pull-request from 5.0.2 to 6.0.5
#976
dependabot[bot]
closed
6 months ago
0
chore(deps): bump docker/setup-buildx-action from 3.2.0 to 3.3.0
#975
dependabot[bot]
closed
6 months ago
0
chore(deps): bump vllm from 0.4.0 to 0.4.2 in /openllm-python
#974
dependabot[bot]
closed
6 months ago
1
fix: update correct CompletionOutput object
#973
aarnphm
closed
6 months ago
0
feat: Multimodal LLMs?
#972
Trickster85
opened
6 months ago
1
bug: pip package version ssues
#971
vilewired
closed
6 months ago
0
chore(deps): bump taiki-e/install-action from 2.32.9 to 2.33.9
#970
dependabot[bot]
closed
6 months ago
0
chore(deps): bump vllm from 0.4.0 to 0.4.1 in /openllm-python
#969
dependabot[bot]
closed
6 months ago
1
For AMD/GPU, how to use multi GPUS in the api_server.py
#968
williamZQ
closed
4 months ago
2
bug: error coming up while install the vllm using pip install "openllm[vllm]"
#967
Developer-atomic-amardeep
closed
4 months ago
1
feat: support LMDeploy backend
#966
zhyncs
closed
3 months ago
7
bug: WARNING: openllm 0.4.44 does not provide the extra 'gemma'
#965
infinite-Joy
closed
5 months ago
1
Update README.md
#964
parano
closed
7 months ago
0
chore(deps): bump taiki-e/install-action from 2.32.9 to 2.33.3
#963
dependabot[bot]
closed
6 months ago
1
feat: Can you support llama3?
#961
ICLXL
closed
6 months ago
3
bug: Not enough data for satisfy transfer length header
#960
Cherchercher
closed
4 months ago
3
ci: pre-commit autoupdate [pre-commit.ci]
#959
pre-commit-ci[bot]
closed
6 months ago
0
chore(deps): bump pypa/gh-action-pypi-publish from 1.8.11 to 1.8.14
#958
dependabot[bot]
closed
6 months ago
0
chore(deps): bump taiki-e/install-action from 2.32.9 to 2.32.17
#957
dependabot[bot]
closed
7 months ago
1
chore(deps): bump docker/metadata-action from 5.5.0 to 5.5.1
#956
dependabot[bot]
closed
6 months ago
0
chore(deps): bump actions/setup-python from 5.0.0 to 5.1.0
#955
dependabot[bot]
closed
6 months ago
0
Previous
Next