triton-inference-server / local_cache

Implementation of a local in-memory cache for Triton Inference Server's TRITONCACHE API
BSD 3-Clause "New" or "Revised" License
5 stars 1 forks source link

Improve LRU updates (#7) #8

Closed mc-nv closed 1 year ago

rmccorm4 commented 1 year ago

Is the target branch right? Merging into main? I don't understand how this PR is different from current main