-
### Willingness to contribute
No. I cannot contribute this feature at this time.
### Proposal Summary
The 2.12.2 release added support for the `predict_stream` method for custom Python models. Whil…
-
Hi, your tutorial is very helpful to me!!! Thank you very much.
I read your code many times, and I found it is not include __How to Save Model__, as I know, since tf 1.10 and tf-serving out, Tensorf…
-
### Describe the bug
I am using the pytorch and ResNet model serving with bentoml in production. Using this model, I developed an API to extract features of two images and compare similarities.
H…
-
https://github.com/tensorflow/recommenders/blob/main/docs/examples/basic_retrieval.ipynb
```
# Export the query model.
with tempfile.TemporaryDirectory() as tmp:
path = os.path.join(tmp, "model"…
-
Would love to see an integration of the outlines library (https://github.com/outlines-dev/outlines)
-
当训练神经网络模型后,通过在guest方deploy-publish-bind操作后,在线推理返回结果无score
{"retcode":0,"retmsg":"","data":{"modelId":"guest#9999#arbiter-10000#guest-9999#host-10000#model","modelVersion":"202303150203349569250","tim…
-
- 【FastDeploy版本】:fastdeploy:1.0.4-cpu-only-21.10
- 【系统平台】: 官方docker
报错如下
```
0904 12:09:52.059001 1627 pb_stub.cc:402] Failed to process the request(s) for model 'det_postprocess_0', message: At…
-
Hi,
I am following the instruction of “deep_recommenders.ipynb” notebook. I’ve done with the model training and also create the “BruteForce” layer to make the prediction.
However, when I try to s…
yuwin updated
3 years ago
-
### System information
- **OS Platform and Distribution**: Window 11 + WSL2 Ubuntu 22.4.03 LTS
- **TensorFlow Serving installed from (source or binary)**: Docker Image tensorflow/serving:2.17.0
- *…
-
We noticed a particular scenario with the Knative progressive serving rollout, which we need input on.
We have a cluster with 2 GPUs
Initially, we apply isvc with replicas as 1
```
NAME …