-
Hi Guy,
Really intrigued by this.
I'd like to experiment with it on a couple machines each with NVIDIA GPU and Pytorch compiled to take advantage of GPU (CUDA 9) and a master node (if needed) th…
-
I am getting the following error when doing prediction after deploying model in cloud
In my local
C:\Program Files (x86)\Google\Cloud SDK>gcloud ml-engine predict --model Deep_Wide --version v4 -…
-
hi i am trying to export the model into .pb using https://github.com/amir-abdi/keras_to_tensorflow but i am getting an error : NameError: name 'tf' is not defined
Any ideas how to convert the model?…
-
### Is your feature request related to a problem?
There is currently no support to serve batches that satisfy some valid criteria. It would be nice to filter out batches based on some criteria such…
-
## 🚀 Feature
TorchStore is a key-value store that holds ATen tensors in shared memory so that they can be accessed across process boundaries without any expensive copy operations.
## Problem
…
-
**System information**
- TensorFlow version (you are using): 2.4.0
- Are you willing to contribute it (Yes/No): Yes - tough I have no experience with developing tf ops
**Describe the feature and …
-
### Anything you want to discuss about vllm.
I am trying to perform a serving performance test using pipeline parallelism with the LLAMA 3.1 405B model as a draft model with 8b, but the model fails t…
-
Thanks for your great implementation of EdgeRealtimeVideoAnalytics.
I have a question Which video server you used for This project Pipe Line .
i.e
video server like WebRTC and FFMPEG.
Thanks
…
-
We have a Spark ML pipeline with SQLTransformer along with UDF.
I checked at https://github.com/combust/mleap/tree/master/mleap-spark/src/main/scala/org/apache/spark/ml/bundle/ops/feature
and didn…
-
### 1. System information
- Linux Ubuntu 16.04:
### 2. Code
Provide code to help us reproduce your issues using one of the following options:
#### Option A: Reference colab notebooks
Refer…