Implemented FileDataSourceV2 instead of RelationProvider to register a customized file format.
3 major diffs you may care:
metadata.json is now saved before we save the dataframe, because I don't see a way to save it after we save the dataframe under the new API, and it seems fine to change the order
RikaiOptions has changed for being serializable, the new API need it serializable.
The default save old is not overwrite under new API, so we need to set save mode manually to keep safe.
This patch closes https://github.com/eto-ai/rikai/issues/640
Implemented
FileDataSourceV2instead ofRelationProviderto register a customized file format.3 major diffs you may care:
metadata.jsonis now saved before we save the dataframe, because I don't see a way to save it after we save the dataframe under the new API, and it seems fine to change the orderRikaiOptionshas changed for being serializable, the new API need it serializable.