-
**🚀 Feature**
need inference api which can be used in java.
-
### Motivation: Why do you think this is important?
It should be possible to use an ffcv datawriter and data loader and output and inputs.
libffcv improves data pipelining especially for vision mode…
-
/opt/conda/lib/python3.7/site-packages/mmcv/__init__.py:21: UserWarning: On January 1, 2023, MMCV will release v2.0.0, in which it will remove components related to the training process and add a data…
-
When can NAV support creating Triton Repo for this new backend? Is it on your roadmap?
https://github.com/triton-inference-server/tensorrtllm_backend
-
I am getting the error:
```
(node:40885) UnhandledPromiseRejectionWarning: Error: Failed to run the model: Unexpected input data type. Actual: (N11onnxruntime11NonOnnxTypeIiEE) , expected: (N11onnxr…
-
D Calc tensor Reshape_844 (1, 1, 270, 480)
E Calc node ScatterND : ScatterND_397 output shape fail
W ----------------Warning(2)----------------
E Catch exception when loading onnx model: model.onnx…
-
When i execute /examples/onnx/resnet50v2/test.py i got an error:
`--> config model
done
--> Loading model
Calc node Conv : resnetv24_conv0_fwd output shape fail
E Catch exception when loading o…
-
susie.sun@yz-amd1:~$ docker run -it rocm/deepspeed:rocm5.7_ubuntu20.04_py3.9_pytorch_2.0.1_DeepSpeed /bin/bash
root@c50e90963e1a:/var/lib/jenkins# deepspeed --num_gpus 1 deploy.py
[2023-12-14 01:52:…
-
### Description
When using a ML model with that outputs sparse vectors (like ELSER), it's possible that some times the inference pipeline fails when indexing new documents and new ingested documents …
-
Currently to retrieve a list of Trained Model the UI performs several API calls:
- Get trained models with associated pipelines (`/ml/trained_models?with_pipelines=true&with_indices=true`)
- Get …