v7labs / darwin-py

Library and commandline tool for managing datasets on darwin.v7labs.com
MIT License
115 stars 42 forks source link

[DAR-2045][External] Multi-threaded annotation imports #880

Closed JBWilkie closed 3 months ago

JBWilkie commented 3 months ago

Problem

Importing annotations only works in a single-threaded fashion. This results in a significant bottleneck when sending import API requests in series

Solution

Add optional multi-threading to significantly improve speed when importing annotations. Pass the use_multi_cpu flag as True to enable multi-threading

Changelog

Added option to import annotations with multi-threading, resulting in significant speed gains

linear[bot] commented 3 months ago

DAR-2045 Implement multi-threading when sending import annotation requests