xorbitsai / xoscar

Python actor framework for heterogeneous computing.
https://xoscar.dev
Apache License 2.0
91 stars 21 forks source link

FEAT: Support copy_to semantic, from buffer to buffer #23

Closed ChengjieLi28 closed 1 year ago

ChengjieLi28 commented 1 year ago
  1. Support copy_to, from list of buffers to list of buffers. Means that when xo.copy_to is invoked, the data has already been transferred to the destination buffer.
  2. Ucx copy_to

Tested for TPCH SF100 and SF1000.

Ref: https://github.com/xprobe-inc/mars/pull/77

Check code requirements

codecov[bot] commented 1 year ago

Codecov Report

Merging #23 (bf228b1) into main (56b832b) will increase coverage by 5.18%. The diff coverage is 97.36%.

@@            Coverage Diff             @@
##             main      #23      +/-   ##
==========================================
+ Coverage   88.42%   93.60%   +5.18%     
==========================================
  Files          42       42              
  Lines        3187     3332     +145     
  Branches      638      668      +30     
==========================================
+ Hits         2818     3119     +301     
+ Misses        286      141     -145     
+ Partials       83       72      -11     
Flag Coverage Δ
unittests 93.45% <97.36%> (+5.16%) :arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
python/xoscar/backends/router.py 95.53% <96.15%> (+1.86%) :arrow_up:
python/xoscar/backends/context.py 93.93% <96.66%> (+6.90%) :arrow_up:
python/xoscar/backends/communication/ucx.py 92.72% <96.96%> (+26.33%) :arrow_up:
python/xoscar/backends/core.py 96.33% <100.00%> (+2.92%) :arrow_up:
python/xoscar/backends/indigen/pool.py 92.77% <100.00%> (+8.33%) :arrow_up:
python/xoscar/backends/pool.py 95.91% <100.00%> (+5.48%) :arrow_up:
python/xoscar/backends/test/pool.py 98.46% <100.00%> (ø)

... and 2 files with indirect coverage changes