-
Hi, I was following this example https://modelserving.com/blog/creating-stable-diffusion-20-service-with-bentoml-and-diffusers
or this by git clone of this example repo https://github.com/bentoml/…
-
### Feature request
~~~Python
@bentoml.service(
traffic={"timeout": 600},
workers=8,
resources={"cpu": "1"}
)
class ControlNet:
# Pass the dependent Service class as an argument
…
-
**Describe the bug**
After model deployment service is not responsive due to error.
**To Reproduce**
1. Follow steps in aws-lambda-deplyoment repository: https://github.com/bentoml/aws-lambda-dep…
-
# BentoML 을 활용하여 딥러닝 모델 API 서빙하기
‘투자줌 뉴스 카테고리 분류 딥러닝 모델’을 BentoML 로 패키징하여 서빙한 경험에 대해 공유합니다.
[https://zuminternet.github.io/BentoML/](https://zuminternet.github.io/BentoML/)
-
### Feature request
BentoML previously supported SpaCy as one of its built-in runner types. However, with the introduction of the v1.0.0 release, native support for SpaCy was removed.
It would be …
-
Add End to End test by deploying to the cloud service and Terraform
### Operatos to add
- [ ] bentoml/aws-lambda-deploy#38
- [ ] bentoml/aws-sagemaker-deploy#38
- [ ] bentoml/aws-ec2-deploy#23
…
-
I am getting an error when trying to run _terraform apply -var-file=bentoctl.tfvars -auto-approve_
`error creating Security Group (test-bentoml-ec2-bentoml-sg): VPCIdNotSpecified: No default VPC fo…
-
When I try to run this code:
```python
import tensorflow as tf
from bentoml import BentoService, api, artifacts
from bentoml.adapters import ImageInput
from bentoml.frameworks.keras import Ke…
-
how can i use openllm for local lora model?
-
**Describe the bug**
Building bentos with the AWS Lambda operator with custom Dockerfile templates does not work. It seems that the AWS lambda operator uses its own Dockerfile template without regar…