-
![image](https://user-images.githubusercontent.com/58454582/217485237-0e8d0ef0-5fad-412…
-
### Is your feature request related to a problem? Please describe
i see latest nightly has pull and list available like ollama - awesome.
allows me to use ollama list/pull.
any chance to trigge…
-
Currently we use DL4J for serving Keras models.
For the "old" multi-backend Keras, this is pretty robust.
For TensorFlow 2.0 Keras models, they may include general TF ops (not just Keras layers) tha…
-
Hello, I have a suggestion for a notebook -- an **example of a cuml trained model being exported so it can be served by TensorRT.**
More information on TensorRT:
- https://docs.nvidia.com/deeplear…
-
**System information**
- OS Platform and Distribution: Both MacOS and Ubuntu 18 (Tensorflow/serving)
- TensorFlow version (use command below): 2.0.0
- Python version: 3.6
**Describe the current …
-
**Summary**
Sometimes features passed to TF Serving need to be wrapped in brackets to match the dimension, and the correct dimensions are required.
However, in some cases if the incorrect dimension…
-
I am trying to serve 8 models in a single runtimen ( MLServer Custom Runtime). To crease the serving runtime I created sparate class for each model like `models.py`:
```
class model_1(MLModel):
…
-
## Bug Report
### System information
- **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Ubuntu 20.04 / Kubernetes on AWS
- **TensorFlow Serving installed from (source or binary)**: bi…
-
```bash
root@0d038e7669f4/workspace # echo $PYTHONPATH
/usr/local/lib/openvino/inference_engine/:
root@0d038e7669f4/workspace # ie_serving
Traceback (most recent call last):
File "/usr/bin/ie_s…
-
**Describe the bug**
Using a custom container to serve a Pytorch model, defined as below, it throw "No space left on device"
```
container = {"Image": image, "ModelDataUrl": model_artifact}
cr…