This PR made the original codes as the core module for COOL and add an extension module cool-extensions for supplementary functionalities (e.g. the new Parquet Loader in this PR) and a module cool-examples for sample codes and tutorials to be described in the COOL-site. Below are a detailed list of changes.
Refactor LocalLoader into DataLoader for easier extension with other format regulated by the new DataLoaderConfig class. New extensions only needs to extend the DataLoaderConfig to provide appropriate TupleReader and TupleParser.
Add a new implementation of TupleParser that accepts a tuple in Json String.
Add Parquet loading support with ParquetDataLoaderConfig accompanied with a new TupleReader implementation that can emit tuples in Json String from Parquet files.
The old data loading example with logic inside LocalLoader main method is moved to cool-examples. After building the executable jar behaves the same as LocalLoader main method as before. (This is to keep our core module clean)
A example to demonstrate the usage of the new Parquet Loader is also provided.
This PR made the original codes as the core module for COOL and add an extension module
cool-extensions
for supplementary functionalities (e.g. the new Parquet Loader in this PR) and a modulecool-examples
for sample codes and tutorials to be described in the COOL-site. Below are a detailed list of changes.