Fix lru cache evicted/non_evicted nodes

WukLab / preble

Stateful LLM Serving

Apache License 2.0

32 stars 4 forks source link

Closed vikranth22446 closed 5 months ago

vikranth22446 commented 5 months ago

Currently, there's a bug where you pass by reference during a tree split. Fixed via copy.deepcopy