Set timeouts on requests made internally by the `inference` - Githubissues

roboflow / inference

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

https://inference.roboflow.com

Other

1.27k stars 107 forks source link

Set timeouts on requests made internally by the `inference` #566

Open PawelPeczek-Roboflow opened 1 month ago

PawelPeczek-Roboflow commented 1 month ago

Search before asking

[X] I have searched the Inference issues and found no similar bug report.

Bug

Currently, there is no control over timeouts while making internal requests in library:

we need to expose such control knob from functions making request
set reasonable default that can be controlled via env otherwise we may end up having issues with such components like InferencePipeline attempting to communicate with RF backend - for instance while running workflows

Environment

No response

Minimal Reproducible Example

No response

Additional

No response

Are you willing to submit a PR?

[ ] Yes I'd like to help by submitting a PR!

PawelPeczek-Roboflow commented 1 month ago

@grzegorz-roboflow - just for visibility