-
Hi guys,
I've been trying to package the model and deploy with Tensorflow Serving for a while following examples from #316 #615. Thanks to all of you there (@xolott, @Cecilwang, @dingqs447, @viveka…
-
Hi!
Could you please add `tensorflow_serving` [protobufs](https://github.com/tensorflow/serving/tree/master/tensorflow_serving/apis) to the Go package as well? They depend on the `tensorflow/core/`…
-
failed at make - linking stage:
```
[root@master /data/home/richliu/tf-serving-client-cpp/build]# make
[ 2%] Running gRPC C++ protocol buffer compiler on proto/tensorflow_serving/apis/prediction…
-
**Prerequisites**
_x-posted to bert-serving repo, as well, with apologies, as I, am not sure which is the culprit._
> Please fill in by replacing `[ ]` with `[x]`.
* [x ] Are you running the la…
-
Your documentation [mentions](https://ydf.readthedocs.io/en/latest/#:~:text=and%20TensorFlow%20Records.-,Serving,-Benchmark%20model%20inference) :
> Run models in Python, C++, Go, JavaScript, and C…
-
The current release of the What-If Tool plugin includes generated Python protos that are incompatible with the 4.x protobuf runtime, leading to this error at startup when the virtual environment only …
-
Thank you for your cppflow lib. I'm integrated this lib in my inference server.
but I encountered some problem.
my model is like this
```
MetaGraphDef with tag-set: 'serve' contains the follo…
-
**Prerequisites**
> Please fill in by replacing `[ ]` with `[x]`.
* [x ] Are you running the latest `bert-as-service`?
* [x] Did you follow [the installation](https://github.com/hanxiao/bert-as…
-
The last official ScaNN TF Serving Docker image is [v2.11.0](https://hub.docker.com/layers/google/tf-serving-scann/2.11.0/images/sha256-dbbaeb571883546ca6ea9f7eeba58917a030ae8f7ff0bf1a814fa68b3ded4e55…
-
This would provide the ability to serve multiple models, and multiple versions of each model, with a single serving instance.
Details can be seen here: [https://www.tensorflow.org/tfx/serving/servi…