search

triton-inference-server / pytriton

PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
https://triton-inference-server.github.io/pytriton/
Apache License 2.0
719 stars 50 forks source link

How to check if the server-side service is still online through the client-side? #30

Closed lfxx closed 1 year ago

lfxx commented 1 year ago

How to check if the server-side service is still online through the client-side?

jkosek commented 1 year ago

You can use a wait_for_model method from our ModelClient. More here: https://github.com/triton-inference-server/pytriton/blob/main/pytriton/client/client.py#L196.

Would that work?

lfxx commented 1 year ago

You can use a wait_for_model method from our ModelClient. More here: main/pytriton/client/client.py#L196.

Would that work?

this makes sense.Thank you.