-
We are currently not evaluation our recall process in the evaluation framework. Our recall process involves both ELSER and the LLM, and we should add some kind of test to see how well this process wor…
-
### Describe the issue
inference speed is very slow when using fp16 while using fp 32 is normal
### To reproduce
inference speed is very slow when using fp16 while using fp 32 is normal
### Urge…
-
First of all, thank you for `utoipa`!
## Context
We use `utoipa` to generate the OpenAPI spec for a web service, which - among other things - proxies requests for a category of Providers of data…
-
# 启动server
python toolbench/inference/toolbench_server.py \
--tool_root_dir data/toolenv/tools/ \
--corpus_tsv_path data/retrieval/G1/corpus.tsv \
--retrieval_model_path /share/ToolBen…
-
**Description**
Hi, I'm trying to use conda-packs inside my configs.pbtxt for Python backends. When I add them, they load successfully, but the model with `backend: "onnxruntime"` reports the follow…
-
Thanks to @nswamy for his inputs and design discussions related to this project and @frankfliu for explaining the requirements and the use case from customer perspective.
# Problem Statement
One…
-
### Describe the issue
I have an object detection model that's trained using pytorch and exported to onnx. By default batch size for inference is set to 1 and see inference time of 720ms.
As an e…
-
more details to begin with are [here](https://www.freecodecamp.org/news/language-server-protocol-and-the-future-of-ide/)
Muxas updated
3 months ago
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### Where…
-
python3 detectnet.py --model=peoplenet pedestrians.mp4 pedestrians_peoplenet.mp4
[gstreamer] initialized gstreamer, version 1.14.5.0
[gstreamer] gstDecoder -- creating decoder for pedestrians.mp4
O…