-
Hi zjjMaiMai,
After I trained a model I have full check point file and graph.pbtxt, but when I want to freeze model, I cannot execute it.
I flow this:
bazel build tensorflow/tools:freeze_graph
baz…
-
## Description
I have updated DJL to version 0.23.0 and PyTorch to version 2.0.1. However, I encountered an issue with infinite end-to-end latency increase when performing multi-threaded inference …
-
### Your current environment
Not applicable -- Dockerfile.
### 🐛 Describe the bug
Steps to reproduce:
- Clone the `vllm` repo
- run `docker build . --target vllm-base`
- Build fails
```shel…
-
Authors : [Hamid Shojanazeri](https://github.com/HamidShojanazeri), [Shen Li](https://github.com/mrshenli)
## **Problem statement**
Currently, Torchserve does not have a general solution for s…
-
**Description**
When cycling through the `load model` -> `infer` -> `unload model` scenario we observe a GPU memory leak.
This only happens when models are in Torchscript format. There is no leak…
-
-
### 1. System information
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04):Linux Ubuntu 18.04
- TensorFlow installation (pip package or built from source):docker pull
- TensorFlow librar…
-
### 🐛 Describe the bug
Suppose you have a network which operates on dynamically sized inputs / has data dependent dynamism internally. Our default policy is to represent such a tensor as compactly as…
-
**System information**
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Ubuntu 18.04
- TensorFlow version and how it was installed (source or binary): 2.4.1
- TensorFlow-Addons version an…
-
Thank you for submitting an issue. Please refer to our [issue policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md) for additional information about bug reports. For help with debu…