search

SeldonIO / MLServer

An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
https://mlserver.readthedocs.io/en/latest/
Apache License 2.0
726 stars 183 forks source link

Cannot import "Conversation" #1955

Open Phyks opened 1 week ago

Phyks commented 1 week ago

Hi,

The example HuggingFace pipeline does no longer work and fails with an error "Cannot import Conversation from transformers.pipelines": https://github.com/SeldonIO/MLServer/blob/master/docs/examples/huggingface/README.md.

As per https://discuss.huggingface.co/t/cannot-import-conversation-from-transformers-utils-py/91556/1, downgrading transformers library to version 4.41.2 (pip install transformers==4.41.2) does the trick and fixes the pipeline.

transformers dependency should probably be pinned to a stricter version, or the import should be fixed in huggingface runtime.

Best,

sakoush commented 1 week ago

@Phyks Thanks for your reporting this issue. I think it is better to fix the underlying issue with the import. We welcome contributions if you are happy to provide a fix for it. Thanks!