-
I'v been looking in previous issues, but I could not find satisfying answer.
I have packed model using model-archiver in docker.
```bash
docker run --rm -it --name mar -v $(pwd)/output:/output …
-
I tried generating new models with different input size from https://github.com/DeGirum/ultralytics_degirum, but the scripts are not working. There is a clear typo in https://github.com/DeGirum/ultral…
-
Hello
I am trying to get shap_values using DeepExplainer but it keep giving this error
"AttributeError: module 'tensorflow.python.eager.backprop' has no attribute '_record_gradient'"
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### YOLOv8 Component
Predict
### Bug
718 …
-
- [ ] [OpenCodeInterpreter/README.md at main · OpenCodeInterpreter/OpenCodeInterpreter](https://github.com/OpenCodeInterpreter/OpenCodeInterpreter/blob/main/README.md?plain=1)
# OpenCodeInterpreter/…
-
## 🚀 Feature
**Document: https://torchserve-docs.s3-us-west-2.amazonaws.com/docs/torchserve_architecture_v0.pdf**
**NOTE: The above document is a draft and subject to change**
Request to buil…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [x] I am using the latest TensorFlow Model Garden release and TensorFlow 2.
- [x] I am reporting…
-
Running the server (using the vLLM CLI or our [docker image](https://docs.vllm.ai/en/latest/serving/deploying_with_docker.html)):
* `vllm serve meta-llama/Llama-3.2-11B-Vision-Instruct --enforce-eage…
-
Hi All,
I would like to get you help on the following Ensemble architecture:
created this [colab](https://colab.research.google.com/drive/1e8MwwMEa8GOeeYUeUEZZRJtoDpl4oESv?usp=sharing) notebook f…
-
Since vLLM 0.2.5, we can't even run llama-2 70B 4bit AWQ on 4*A10G anymore, have to use old vLLM. Similar problems even trying to be two 7b models on 80B A100.
For small models, like 7b with 4k to…