huggingface / Google-Cloud-Containers

Including Hugging Face Deep learning Containers for Google Cloud
Apache License 2.0
112 stars 10 forks source link

Patch `huggingface-inference-toolkit` wheel in PyTorch Inference containers #66

Closed alvarobartt closed 1 month ago

alvarobartt commented 1 month ago

Description

This PR fixes a bug introduced in the huggingface-inference-toolkit version 0.4.2, affecting sentence-transformers due to the propagation of the kwargs such as the trust_remote_code flag, which was leading to some issues, so those have now been patched so that trust_remote_code and other allowed kwargs can be provided, while some are popped in advanced as not supported e.g. tokenizer or framework.