-
Have been working on model ensemble, continuing conversations from https://github.com/allegroai/clearml-serving/issues/53, just thought it may be a better idea to create new issues for different thing…
-
/kind bug
**What steps did you take and what happened:**
Basically I saved my yolov8 model as an Onnx model and I tried to follow the documentation for serving.
When I'm trying to do simple infer…
-
## Why a model management module is needed?
Currently, the model management capability of Sedna is fragmented and has the following problems:
#### 1. Unclear module responsibilities.
It is foun…
-
**Prerequisites**
> Please fill in by replacing `[ ]` with `[x]`.
* [x] Are you running the latest `bert-as-service`?
* [x] Did you follow [the installation](https://github.com/hanxiao/bert-as-…
-
### 问题确认 Search before asking
- [X] 我已经搜索过问题，但是没有找到解答。I have searched the question and found no related answer.
### 请提出你的问题 Please ask your question
您好，我在Windows Server 2016上部署模型时遇到了FileNotFoundEr…
-
Poor air quality is becoming more of [an impactful environmental element ](https://www.npr.org/2024/04/18/1245068810/wildfire-smoke-contributes-to-thousands-of-deaths-each-year-in-the-u-s#:~:text=Even…
-
Hi guys, thanks for the work on this library.
I am trying to reduce the checkpoint size and memory overhead of a model using AQT. Currently, when we quantize the parameters of a Flax model for serv…
-
-----------------------
### [InactiveRpcError of RPC that terminated with: status = StatusCode.FAILED_PRECONDITION, details = "Attempting to use uninitialized value dense_2/bias]
Getting follo…
-
yolov5使用OpenVINO没有找到可以进行int8量化的配置
参考文档https://github.com/PaddlePaddle/FastDeploy/blob/4e9bcc37183a8c4874551517c840d8078e31cfc3/serving/docs/zh_CN/model_configuration.md
-
Platform (like ubuntu 16.04/win10):
Ubuntu14.04
Python version:
2.7
Source framework with version (like Tensorflow 1.4.1 with GPU):
TensorFlow1.4 gpu
Destination framework with version (like CNT…