search

fugue-project / fugue

A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
https://fugue-tutorials.readthedocs.io/
Apache License 2.0
1.98k stars 94 forks source link

[FEATURE] Deprecate register_raw_df_type #403

Closed goodwanghan closed 1 year ago

goodwanghan commented 1 year ago

We will deprecate this function, anyone using this function will receive a DeprecationWarning

Instead, we will use fugue.api.is_df to register raw df for example

import dask.dataframe as dd
from fugue.plugins import is_df

@is_df.candidate(lambda df: isinstance(df, dd.DataFrame))
def _dd_is_df(df: dd.DataFrame) -> bool:
    return True