mars-project / mars

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
https://mars-project.readthedocs.io
Apache License 2.0
2.68k stars 325 forks source link

Vineyard: from unordered chunks. #3324

Closed sighingnow closed 1 year ago

sighingnow commented 1 year ago

What do these changes do?

Fixes bugs in processing chunk index of vineyard's global dataframe.

The global dataframe may be generated by upstream systems and is row-splitted without a valid global chunk_index value.

Related issue number

N/A

Check code requirements