triton-inference-server / local_cache

Implementation of a local in-memory cache for Triton Inference Server's TRITONCACHE API
BSD 3-Clause "New" or "Revised" License
4 stars 1 forks source link

Avoid unintended copy #6

Closed GuanLuo closed 1 year ago