[P0] [SPIKE] - OOTB support for NVIDIA Triton Inference Server

opendatahub-io / modelmesh-serving

Controller for ModelMesh

Apache License 2.0

3 stars 31 forks source link

[P0] [SPIKE] - OOTB support for NVIDIA Triton Inference Server #184

Open heyselbi opened 11 months ago

heyselbi commented 11 months ago

From req doc: OOTB support for NVidia Triton Inference Server

We are going with OpenVINO right now as Triton can not be built right now due to maintenance concerns.

Acceptance criteria:

Scope of work needed

bdattoma commented 10 months ago

@heyselbi this is a SPIKE, hence can I assume that Triton is not targeted for 1.36?

heyselbi commented 10 months ago

@bdattoma the scoping of the work needed for sure will be complete by 1.36 but the delivery of the feature itself most likely will be next year due to prioritization of other efforts.

bdattoma commented 10 months ago

got it, thank you!