search

mars-project / mars

Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.
https://mars-project.readthedocs.io
Apache License 2.0
2.7k stars 326 forks source link

[BUG] mars tiling odps source reader hang #3095

Closed chaokunyang closed 2 years ago

chaokunyang commented 2 years ago

Describe the bug mars tiling odps source reader hang: image

To Reproduce To help us reproducing this bug, please provide information below:

  1. Your Python version: 3.7.9

  2. The version of Mars you use: 0.9.0 / 9cfcc946c789776121b8b4da87329166e527d154

  3. Versions of crucial packages, such as numpy, scipy and pandas: numpy1.19.5, pandas1.3.5

  4. Full stack of the error. image tmp_1653803192_496397-2022-05-29T13_44_34+08_00

  5. Minimized code to reproduce the error.

    df = o.to_mars_dataframe(input_table_name, columns=["id","a","b"], chunk_size=400).head(8000)
df = df.astype({'id': 'string','a':'float','b':'float'}).execute()
print(df.shape)

Expected behavior A clear and concise description of what you expected to happen.

Additional context Add any other context about the problem here.

wjsi commented 2 years ago

Not a Mars issue. Move to pyodps repo.