deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution
Apache License 2.0
182 stars 59 forks source link

[0.28.0-dlc] spec decoding cache dirty fix #2128

Closed sindhuvahinis closed 6 days ago

sindhuvahinis commented 6 days ago

Description

Brief description of what this PR is about