deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution
Apache License 2.0
182 stars 59 forks source link

[lmi][hf]remove usage of HF Conversational pipeline as it is deprecated #2124

Closed siddvenk closed 6 days ago

siddvenk commented 6 days ago

Description

Conversation, and "conversation" task for hf pipelines have been removed in release 4.42.0 https://github.com/huggingface/transformers/releases/tag/v4.42.0.

Removing usage from our handler.

This use-case is now handled by the text-generation pipeline from hf. I think some updates are needed there to make it work, but for now just removing the usage.