issues
search
bentoml
/
OpenLLM
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
9.7k
stars
616
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
bug: Pydantic feature deprecated, need downgrade on latest pip version
#1076
TownsendSP
opened
1 day ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#1075
pre-commit-ci[bot]
closed
4 days ago
0
chore(deps): bump pypa/gh-action-pypi-publish from 1.9.0 to 1.10.0
#1074
dependabot[bot]
closed
4 days ago
0
chore(deps): bump actions/setup-python from 5.1.1 to 5.2.0
#1073
dependabot[bot]
closed
4 days ago
0
chore(deps): bump actions/upload-artifact from 4.3.6 to 4.4.0
#1072
dependabot[bot]
closed
4 days ago
0
chore(deps): bump openai from 1.42.0 to 1.43.0
#1071
dependabot[bot]
closed
4 days ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#1070
pre-commit-ci[bot]
closed
1 week ago
0
chore(deps): bump openai from 1.41.0 to 1.42.0
#1069
dependabot[bot]
closed
1 week ago
0
bug: on running openllm run <model-name>, Because vllm-flash-attn==2.5.9.post1 has no wheels with a matching Python ABI tag and you require vllm-flash-attn==2.5.9.post1, we can conclude that your requirements are unsatisfiable.
#1068
sayakmisra
closed
1 week ago
1
fix(cloud): respect user-set BENTOML_HOME
#1067
aarnphm
closed
2 weeks ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#1066
pre-commit-ci[bot]
closed
2 weeks ago
0
chore(deps): bump openai from 1.38.0 to 1.41.0
#1065
dependabot[bot]
closed
2 weeks ago
0
bug: `openllm run phi3:3.8b-ggml-q4` build fails to find FOUNDATION_LIBRARY
#1064
sij1nk
opened
3 weeks ago
2
bug: `TypeError: Argument() missing 1 required positional argument: 'default'`
#1062
djmbritt
closed
2 weeks ago
2
ci: pre-commit autoupdate [pre-commit.ci]
#1061
pre-commit-ci[bot]
closed
2 weeks ago
0
chore(deps): bump actions/upload-artifact from 4.3.5 to 4.3.6
#1060
dependabot[bot]
closed
2 weeks ago
0
chore(deps): bump openai from 1.38.0 to 1.40.3
#1059
dependabot[bot]
closed
2 weeks ago
1
ci: pre-commit autoupdate [pre-commit.ci]
#1058
pre-commit-ci[bot]
closed
1 month ago
0
chore(deps): bump actions/upload-artifact from 4.3.4 to 4.3.5
#1057
dependabot[bot]
closed
1 month ago
0
chore(deps): bump openai from 1.37.1 to 1.38.0
#1056
dependabot[bot]
closed
1 month ago
0
Fresh install complains about vllm-flash-attn==2.5.9.post1 dependency being unsatisfiable
#1055
andrewjwaggoner
closed
3 weeks ago
6
chore: use uv instead of venv layers
#1054
bojiang
closed
1 month ago
0
Struggling to launch OpenLLM with error "No module named bentoml
#1053
andrewjwaggoner
closed
1 month ago
2
feat(venv): support pip options
#1052
rickzx
closed
1 month ago
1
docs: Update OpenLLM readme
#1051
Sherlock113
closed
1 month ago
0
bug: SSL issues
#1049
jacob-riverpoint
closed
1 month ago
3
chore(deps): bump openai from 1.36.1 to 1.37.1
#1048
dependabot[bot]
closed
1 month ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#1047
pre-commit-ci[bot]
closed
1 month ago
0
chore(deps): bump softprops/action-gh-release from 2.0.6 to 2.0.8
#1046
dependabot[bot]
closed
1 month ago
0
chore(deps): bump openai from 1.35.13 to 1.36.1
#1045
dependabot[bot]
closed
1 month ago
0
Can openllm support local path model?
#1044
dsp6414
opened
1 month ago
10
ci: pre-commit autoupdate [pre-commit.ci]
#1043
pre-commit-ci[bot]
closed
1 month ago
0
feat: add gemma2
#1042
bojiang
closed
1 month ago
1
chore(deps): bump openai from 1.35.12 to 1.35.13
#1041
dependabot[bot]
closed
1 month ago
0
infra(style): automatically create release notes from tag
#1040
aarnphm
closed
1 month ago
0
chore: make the UI link clickable in output
#1038
bojiang
closed
1 month ago
0
Documentation
#1037
mikolajpabiszczak
closed
1 month ago
1
chore(deps): bump openai from 1.35.9 to 1.35.12
#1036
dependabot[bot]
closed
1 month ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#1035
pre-commit-ci[bot]
closed
2 months ago
0
chore(deps): bump actions/download-artifact from 4.1.7 to 4.1.8
#1034
dependabot[bot]
closed
2 months ago
0
chore(deps): bump taiki-e/install-action from 2.41.7 to 2.41.11
#1033
dependabot[bot]
closed
2 months ago
0
chore(deps): bump actions/upload-artifact from 4.3.3 to 4.3.4
#1032
dependabot[bot]
closed
2 months ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#1031
pre-commit-ci[bot]
closed
2 months ago
0
chore(deps): bump taiki-e/install-action from 2.41.3 to 2.41.7
#1030
dependabot[bot]
closed
2 months ago
0
chore(deps): update bentoml[grpc] requirement from <1.2,>=1.1.11 to >=1.2.19,<1.3 in /openllm-client
#1029
dependabot[bot]
closed
2 months ago
1
docs: Possible fix in citation
#1027
miorel
closed
2 months ago
0
How to deploy a model using a single machine multi card approach?
#1026
ttaop
opened
2 months ago
1
feat: Include starcoder2
#1025
kobiche
opened
2 months ago
0
ci: pre-commit autoupdate [pre-commit.ci]
#1024
pre-commit-ci[bot]
closed
2 months ago
0
chore(deps): bump softprops/action-gh-release from 2.0.5 to 2.0.6
#1023
dependabot[bot]
closed
2 months ago
0
Next