-
Hi @LukeWood,
For fun, I tried converting stable Diffusion model from Tensorflow to TF lite, so that I can run it on coral/edge tpu.
I tried two approaches:
I- Saved model approach:
II- Go thr…
-
**Describe the bug**
When i try to convert an onnx model to tensorflow a graph is generated which is missing key information such as the names of the input and output nodes for the model. In addition…
-
**System information**
- I have written custom code (described below)
- OS Platform and Distribution (e.g., Linux Ubuntu 16.04): Attempted on Google Colab and Intel Macbook Pro i7
- TensorFlow.js i…
-
```python
try:
# Colab only
%tensorflow_version 2.x
except Exception:
pass
import tensorflow as tf
from tensorflow.keras.layers import Conv2D
from tensorflow.keras.layers import De…
-
## 🐛 Bug
There's a 150x gap in performance for TorchScript ops versus straight Python / C++.
Looping over 100K numbers takes 2+ seconds instead of 18ms or better.
Please see the benchmarks here:…
-
Authors : [Hamid Shojanazeri](https://github.com/HamidShojanazeri), [Shen Li](https://github.com/mrshenli)
## **Problem statement**
Currently, Torchserve does not have a general solution for s…
-
### Your current environment
Using latest available docker image: vllm/vllm-openai:v0.5.0.post1
### 🐛 Describe the bug
I am getting as response "Internal Server Error" when calling the /v1/embedd…
-
Good evening,
I have been trying using the converted model today for object detection with deepsort, without result. Before that, I tried testing it as underlined by you, using the inference command…
-
**Description**
When cycling through the `load model` -> `infer` -> `unload model` scenario we observe a GPU memory leak.
This only happens when models are in Torchscript format. There is no leak…
-
I would like to ensemble several pre-trained models within a single TF graph. I'd like to understand if this is feasible using TensorFlow Transform, and I am planning to use the `tft.apply_saved_model…