-
Hi, I am trying to save a RetinaNet model with the following code:
```python
net = torch.jit.load(_my_model_path, map_location=torch.device('cpu'))
def getstate():
pass
net.__getstate__ =…
-
### Feature request
Just like a `pydantic_model` can be specified in the `bentoml.io.JSON` descriptor, providing an option to specify a `pandera.SchemaModel` in the `PandasDataFrame` descriptor would…
-
**Describe the bug**
After model deployment service is not responsive due to error.
**To Reproduce**
1. Follow steps in aws-lambda-deplyoment repository: https://github.com/bentoml/aws-lambda-dep…
-
Hi, I was following this example https://modelserving.com/blog/creating-stable-diffusion-20-service-with-bentoml-and-diffusers
or this by git clone of this example repo https://github.com/bentoml/…
-
-
# BentoML 을 활용하여 딥러닝 모델 API 서빙하기
‘투자줌 뉴스 카테고리 분류 딥러닝 모델’을 BentoML 로 패키징하여 서빙한 경험에 대해 공유합니다.
[https://zuminternet.github.io/BentoML/](https://zuminternet.github.io/BentoML/)
-
### Motivation: Why do you think this is important?
Flyte is great for data processing/model training in potentially long-running compute processes, and in the context of machine learning, currently …
-
I am getting an error when trying to run _terraform apply -var-file=bentoctl.tfvars -auto-approve_
`error creating Security Group (test-bentoml-ec2-bentoml-sg): VPCIdNotSpecified: No default VPC fo…
-
### Describe the bug
SD generation is incredibly slow running pytorch 1.13.1 + cuda 11.7 when I run Run `BENTOML_CONFIG=configuration.yaml PYTORCH_CUDA_ALLOC_CONF=max_split_size_mb:512 bentoml serve…
-
When I try to run this code:
```python
import tensorflow as tf
from bentoml import BentoService, api, artifacts
from bentoml.adapters import ImageInput
from bentoml.frameworks.keras import Ke…