v6d-io / v6d

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)
https://v6d.io
Apache License 2.0
816 stars 117 forks source link

Fix the inconsistent dataframe in the dataframe_resolver #1933

Closed dashanji closed 3 days ago

dashanji commented 3 days ago

What do these changes do?

In the following case, the current dataframe_resolver still failed.

import pandas as pd
import vineyard
vineyard_client = vineyard.connect()
df = pd.DataFrame({'a': [1, 2, 3, 4], 'b': ['5', '6', '7', '8']})
df = df.iloc[0:0]
object_id = vineyard_client.put(df)
pd.testing.assert_frame_equal(df, vineyard_client.get(object_id))

Related issue number

A missing piece of https://github.com/v6d-io/v6d/pull/1931