ddf-project / DDF

Distributed DataFrame: Productivity = Power x Simplicity For Scientists & Engineers, on any Data Engine
http://ddf.io
Apache License 2.0
168 stars 42 forks source link

Add applySchema to DDF #290

Closed dnsang closed 8 years ago

dnsang commented 8 years ago

Description

Add new feature "ApplySchema", this function will allow to change column types from string to other for data-ingestion. Reviewers: @sameerp @mbbui @PangZhi @nhanitvn @Huandao0812 P/S: Please help to review it carefully, because I'm not familar with Spark so maybe my approach is not efficient.

How to test

UnitTest Cmd: mvn surefire:test -Dtest=SchemaHandlerTest or run SchemaHandlerTest directly from IDEA.

PR Progress

Make sure all checkboxes below are checked before merged