triton-inference-server / openvino_backend

OpenVINO backend for Triton.
BSD 3-Clause "New" or "Revised" License
29 stars 16 forks source link

Replace the contiguous check with common utility #20

Closed GuanLuo closed 3 years ago

GuanLuo commented 3 years ago

Changes related to PR in backend common utility. @tanmayv25 I notice the backend itself doesn't use BackendInputCollector for input collection, is there a reason for doing so, or I should change it to use BackendInputCollector if the input is not contiguous

Tested on resnet50_fp16 and checked that the change does avoid unnecessary copy as compute input time is roughly the same before / after the change (~20 usec). Compute input with copy will be ~90 usec.