-
### Model Name
Predict bioactivity against Main Protease of SARS-CoV-2
### Model Description
MProPred predicts the efficacy of compounds against the main protease of SARS-CoV-2, which is a pr…
-
- Seldon Core: https://github.com/SeldonIO/seldon-core
- KServe: https://github.com/kserve/kserve
- BentoML: https://github.com/bentoml/BentoML
- Ray: https://github.com/ray-project/ray
- Ray Se…
-
My server have no net connection.
How can I manually download a model from Hugging Face into OpenLLM?
-
### Describe the bug.
The YAML check for `install.yml` in GitHub Actions workflows fails because this YAML is invalid. (Occurred here first: https://github.com/ersilia-os/ersilia/pull/790#issuecomm…
-
### Feature request
how to change port number from default 3000
### Motivation
i need to solve the port confilcting in my system.
### Other
_No response_
-
Hi there,
I followed the tutorial in the README and tried to deploy on `ml.g4dn.xlarge` (to run GPU inference)
The cloud watch logs contain the following error
> RuntimeError: The NVIDIA dr…
-
### Describe the bug
In Mac OS, starcoder does not even load, probably because it has no Nvidia GPU.
In Windows, the main issue is the dependency on the `bitsandbytes` library. Since the makers …
-
### Describe the bug
### To reproduce
```
saved_path=$(bentoml get transformers-nlp-service:latest --print-l
ocation --quiet)
```
give the following error:
```
Usage: bentoml get [OPTIONS] BEN…
-
We're having a look at using BentoML. So far looks to be a really good fit, but the problem we have is that we're deploying onto customer premises. So we need to have some protection against reverse e…
-
### Describe the bug
After installating openllm, we run
`openllm models list`
### To reproduce
`pip install openllm`
`openllm models`
### Environment
bentoml==1.1.6
openllm==0.3.6…