-
**Description**
we are trying to host preprocessing model using python/ custom backend.
Python backend is giving very high latency even we are doing very basic look ups. hence we decided to build cu…
-
I have the following `echo`-like `models/modelA/1/model.py`.
How can I call it from a command-line using `curl`?
`curl -i -X POST localhost:8000/api/infer/modelA/1 -H "Content-Type: application/…
-
**Description**
I'm using Triton Server ensemble model for several models connected to each other. Let's say [Model A, Model B, Model C, Model D]. The ensemble model takes input image and pass it s…
-
This doesn't seem to work
/v2/models/ensemble/generate
```
{
"text_input": "...",
"parameters": {
"id": "123",
},
"sequence_id": "456"
}
```
verbose log:
![im…
-
**Description**
We have observed that upon invoking POST /v2/logging API, it creates a new file.
1. Fuzzing with filenames on "log_file" POST body parameter, one can create multiple or infinite
num…
-
**Description**
trying to run
`tritonserver2.35.0-jetpack5.1.2-update-1.tgz`
on a L4T R35.4.1 system with jetpack 5.1.2 results in
`error while loading shared libraries: libboost_system.so.1.80.…
-
**Description**
On the 23.07 release, we are able to load multiple models and instances of a model.
We use:
- `--model-control-mode=explicit` alongside `--load-model=xxx` in the command arguments;…
-
I am serving my not on `/` but on something like `sub1.example.org/mypath`. Dash has an option for that are `requests_pathname_prefix` and `routes_pathname_prefix`. I found that uploader does not take…
-
At AtariAge, someone mentioned, that the demo "Second Life Syndrome" (xex-file zipped and attached) is not running on Atari800MacX and atari800 (which is the base for Atari800MacX).
The demo runs fin…
-
**Description**
1. In SageMaker, we enable `--model-namespacing=true` in order to treat every model repository that is registered as its own namespace.
3. Enabling model namespacing allows us to re…