ebonnal / streamable

[Python] Stream-like manipulation of iterables.
Apache License 2.0
131 stars 0 forks source link

ConcurrentMappingIterable: introduce futuretools.FutureResultCollection to optimize FDFO concurrent mapping (closes #20) #21

Closed ebonnal closed 2 months ago

ebonnal commented 2 months ago

Optimize First Done First Out aka unordereded mapping.

Removes the overhead of using futures waiting functions (asyncio.wait(..., FIRST_COMPLETED) or concurrent.futures.wait(..., FIRST_COMPLETED)) that register and remove waiters/callbacks for all futures for each next.

codecov-commenter commented 2 months ago

:warning: Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 100.00%. Comparing base (562c6b8) to head (18fd582).

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #21 +/- ## ========================================= Coverage 100.00% 100.00% ========================================= Files 13 14 +1 Lines 1198 1248 +50 ========================================= + Hits 1198 1248 +50 ``` | [Flag](https://app.codecov.io/gh/ebonnal/streamable/pull/21/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Enzo+Bonnal) | Coverage Δ | | |---|---|---| | [](https://app.codecov.io/gh/ebonnal/streamable/pull/21/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Enzo+Bonnal) | `100.00% <100.00%> (ø)` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=Enzo+Bonnal#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

ebonnal commented 2 months ago

fyi @erezsh 👁️