-
### Describe the bug
I'm experiencing an issue where only the last declared Histogram metric is being collected when using multiple histograms in my BentoML service. The previously declared histogram…
-
### Describe the bug
Task definition:
```
@bentoml.task(
batchable=True,
batch_dim=(0, 0),
max_batch_size=15,
max_latency_ms=1000)
```
Normally a batch o…
-
### Describe the bug
Hi folks,
I'm having a issue to push monitoring logs to Elastic APM through OTLPHttpExporter.
I'm able to send dummy logs with this standalone code and see them in Elasti…
-
Hi.
I run the command from README:
`docker run --gpus all -p 3000:3000 ghcr.io/bentoml/ocr-as-a-service:gpu`
and after pulling it throws an error:
`FileNotFoundError: BentoML config file s…
-
### Feature request
I really appreciated https://docs.bentoml.com/en/latest/guides/testing.html#unit-tests. It would be helpful to include also docs on mocking the bentoml decorated API methods.
…
smidm updated
2 months ago
-
### Feature request
~~~Python
@bentoml.service(
traffic={"timeout": 600},
workers=8,
resources={"cpu": "1"}
)
class ControlNet:
# Pass the dependent Service class as an argument
…
-
There is an issue in the specification of the bentofile.yaml file, specifically in the docker section where the env entry is defined. When the BENTOML_CONFIG environment variable is specified in the e…
-
Hi, hope some one may help pls:
Im getting this error when try to implement my bento on sagemaker:
```
2024-02-07T14:58:58+0000 [INFO] [cli] Service loaded from Bento directory: bentoml.Service(t…
-
how can i use openllm for local lora model?
-
You may have seen our latest announcement on BentoML 1.2 release here: https://bentoml.slack.com/archives/CK8PQU2JY/p1708444803664399
>
> :bento: We are excited to share with you that we have rel…