deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution
Apache License 2.0
182 stars 59 forks source link

[0.28.0-dlc][cherry-pick][fix] Set tokenizer on output_formatter for TRT-LLM Handlers (#2100) #2103

Closed sindhuvahinis closed 1 week ago

sindhuvahinis commented 1 week ago

Description

Brief description of what this PR is about