-
### Describe the bug
Hi,
When trying to query the `meta-llama/Llama-2-7b-chat-hf` with a simple query (i.e. 'Hello'), the query failed with a timeout.
Just to be clear, i launched in a wsl sess…
-
### Buggy output
```
WARNING:torch.distributed.run:
*****************************************
Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system…
-
Regarding high performance of transformer models with TensorRT, would it be envisageable to adapt bentoML to work with?
-
Onediff has started to break after the recent release of newer nighly version of oneflow. I am using onediff.demo and after changing one aspect ratio it is breaking on another aspect ratio.
Please s…
-
This model is ready for testing. If you are assigned to this issue, please try it out using the CLI, Google Colab and DockerHub and let us know if it works!
-
My base image is in an internal Docker registry without TLS. When the image builder (Kaniko) operates, it defaults to pulling images via HTTPS, which leads to a failure in building the image. I notice…
-
-
### Describe the bug
Just trying out the QuickStart guide from [here](https://docs.bentoml.org/en/latest/get-started/quickstart.html).
Using the same service.py file as described in the link.
```…
-
### 🐛 Describe the bug
Hi, I have trained a pytorch RetinaNet3D model using the MONAI framework and would like to serialize it so it can be run with BentoML. However I get the following error using …
-
### Describe the bug
I try to use BentoML for a Lightning Model. The model is a pretrained network from the anomalib library (EfficientAD) https://github.com/openvinotoolkit/anomalib/tree/main/src/…