fastmachinelearning / SonicCMS

Services for Optimized Network Inference on Coprocessors (for CMS)
8 stars 8 forks source link

Update SonicTriton to Triton 2.X and v2 API #10

Closed kpedro88 closed 4 years ago

kpedro88 commented 4 years ago

The triton-inference-server 2.X release series includes resolutions of several relevant issues:

It also changes the client API from v1 to v2. Currently, Triton 2.X is described as "beta quality", with indications that APIs might change. Therefore, we are currently waiting to observe the stability of the API over multiple releases before upgrading.

This update will required simultaneous changes in cms-sw/cmsdist and cms-sw/cmssw, as well as any currently operating servers.

Assigned to: @kpedro88

kpedro88 commented 4 years ago

See: https://github.com/lgray/triton-torchgeo-gat-example/pull/1 https://github.com/cms-sw/cmsdist/pull/6293 https://github.com/cms-sw/cmssw/pull/31715