numaproj / numaflow-python

Numaflow Python SDK
Apache License 2.0
53 stars 18 forks source link

feat: reduce stream per window using asyncio #49

Closed ashwinidulams closed 1 year ago

ashwinidulams commented 1 year ago

This PR introduces support for a stream per window instead of stream per partition. Also asyncio is used to process multiple partitions.

codecov[bot] commented 1 year ago

Codecov Report

Merging #49 (8011061) into main (df9c8c8) will decrease coverage by 2.35%. The diff coverage is 92.22%.

@@            Coverage Diff             @@
##             main      #49      +/-   ##
==========================================
- Coverage   98.55%   96.20%   -2.35%     
==========================================
  Files           9       10       +1     
  Lines         277      343      +66     
  Branches       21       26       +5     
==========================================
+ Hits          273      330      +57     
- Misses          2        8       +6     
- Partials        2        5       +3     
Impacted Files Coverage Δ
pynumaflow/sink/server.py 95.12% <75.00%> (ø)
pynumaflow/__init__.py 83.33% <81.81%> (-16.67%) :arrow_down:
pynumaflow/function/server.py 91.66% <92.10%> (-5.52%) :arrow_down:
pynumaflow/function/_dtypes.py 99.07% <95.45%> (-0.93%) :arrow_down:
pynumaflow/_constants.py 100.00% <100.00%> (ø)
pynumaflow/function/asynciter.py 100.00% <100.00%> (ø)

:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more