microsoft / DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Apache License 2.0
1.91k stars 175 forks source link

Remove Conversation from MII as it was deprecated and removed from transformers. #492

Closed loadams closed 5 months ago

loadams commented 5 months ago

Fixes in MII that correspond to these changes in DeepSpeed

mrwyattii commented 5 months ago

Need to remove the conversational task type unit test, set minimum version of transformers to whatever version removed the task type, and update docs/READMEs to reflect these changes