-
**Describe the bug**
https://github.com/bentoml/aws-lambda-deploy/issues/24
In the current version, `service.asgi_app` only works with the PROMETHEUS_DIR set and exists.
**To Reproduce*…
-
### Describe the bug
The method `buildx.build` support a list of tags [here](https://github.com/bentoml/BentoML/blob/6b80bb533887d219c5bc2d8c01ea1d8dfdb13dc7/bentoml/_internal/utils/buildx.py#L168)…
-
I am trying to serve BentoService with GPU by dockerizing it. However, my docker container fails to load model on to GPU. I am using `TransformersModelArtifact` to save and load the model. Docker cont…
-
**Is your feature request related to a problem? Please describe.**
Currently there is not too much visibility for the user to visualize or to understand how BentoML's micro-batching works. having…
-
Both: https://github.com/bentoml/Yatai/blob/main/api-server/services/image_builder.go#L142 and https://github.com/bentoml/Yatai/blob/main/api-server/services/image_builder.go#L190 should be customizab…
-
### Week 1 - Get to know the community
- [X] Join the communication channels
- [X] Open a GitHub issue (this one!)
- [x] Install the Ersilia Model Hub and test the simplest model
- [x] Write a motiva…
-
**Describe the bug**
When using `bentoml build` with custom base_image in `bentofile.yaml`, an error occurred.
**To Reproduce**
Assume that my bentoml service and runner, api have been implem…
-
Currently, with the `BentoML==1.0.0a4` release, the lambda deployment is broken due because Prometheus `PROMETHEUS_MULTIPROC_DIR` is not being setup correctly.
Error log from CloudWatch
```
[ERRO…
-
### Summary
Hello,
This is a public issue for a virtual daily stand-up. We will use this to briefly share the tasks of the day and the challenges and advances made, so that we can ensure smooth su…
-
**Describe the bug**
When running on a server with 256 threads (128 cores) the bentoml spawns too many threads, so the process is shown to consume ~ 13000% CPU (130 threads) at some time intervals,…