search

v7labs / darwin-py

Library and commandline tool for managing datasets on darwin.v7labs.com
MIT License
115 stars 40 forks source link

[DAR-2707][External] Allow repeated polling of pending export releases #876

Closed JBWilkie closed 2 days ago

JBWilkie commented 3 weeks ago

Problem

Before a dataset release can be pulled, it needs to finish generating. The time taken for this can vary based on export size and current load on the export pipeline. If a release isn't ready for pulling, then darwin-py will throw an error

Solution

Introduce the optional retry parameter (SDK & CLI) that allows polling of pending dataset releases. If the pending release becomes available within the allotted time, it will be automatically downloaded

Changelog

Allow optional polling of pending dataset releases in case the release is not yet ready for download

linear[bot] commented 3 weeks ago

DAR-2707 Allow darwin-py `pull()` to repeatedly poll for a release if it's not ready