using data validator with databricks

pranab / chombo

Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm

http://pkghosh.wordpress.com/

105 stars 73 forks source link

Closed igordaiko closed 6 years ago

igordaiko commented 6 years ago

Can I use csv row validator with databricks? If yes, could you explain how can I install it?

pranab commented 6 years ago

Sure. Please read the blog and follow the instruction in the tutorial. The blog has a link to the tutorial at the end https://pkghosh.wordpress.com/2018/08/20/pluggable-rule-driven-data-validation-with-spark/