Ray 2.5.0 had break changes again! So the dataset_format function becomes deprecated. But in lower version, we rely on it to determine whether the dataframe is empty and also to check whether it is arrow or pandas dataset. In addition, they start to introduce their own Schema class, and changed the return values of a few functions.
It breaks most of the functionalities of Fugue on Ray, so we have to make Fugue compatible from lower version Ray (~2.1.0) to the latest version.
Ray 2.5.0 had break changes again! So the
dataset_formatfunction becomes deprecated. But in lower version, we rely on it to determine whether the dataframe is empty and also to check whether it is arrow or pandas dataset. In addition, they start to introduce their ownSchemaclass, and changed the return values of a few functions.It breaks most of the functionalities of Fugue on Ray, so we have to make Fugue compatible from lower version Ray (~2.1.0) to the latest version.