Currently, the user returns a single Fondant dataframe when loading or transforming data. However, there is a need to split this dataframe into multiple subsets based on component specifications and save each subset into a separate location.
This task involves creating a process that allows for efficient and accurate splitting of the dataframe while ensuring each subset is written to its designated location.
Currently, the user returns a single Fondant dataframe when loading or transforming data. However, there is a need to split this dataframe into multiple subsets based on component specifications and save each subset into a separate location.
This task involves creating a process that allows for efficient and accurate splitting of the dataframe while ensuring each subset is written to its designated location.