Closed Wauplin closed 1 month ago
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
Thanks for the quick review @dacorvo :) Failing tests are unrelated so merging it now.
Should fix warnings in optimum CI cc @dacorvo
At the moment if an error occurs while sending a POST with
AsyncInferenceClient
, we don't catch all errors. This PR makes sure that we close the connection "no matter what" and before raising the exception. Also added a test to ensure that.