Does it support s3 as source ?

agile-lab-dev / DataQuality

DataQuality for BigData

GNU Lesser General Public License v3.0

139 stars 50 forks source link

Does it support s3 as source ? #7

Open sanketvega opened 4 years ago

sanketvega commented 4 years ago

I see there was PR merged wit s3 support in Nov. Does it now support s3 as a source instead of hdfs after this ?

emakhov commented 4 years ago

Hi Sanket, Yes, you would need to add URL to S3 bucket in the application conf in order to use it instead of HDFS, source types in the run confs will be "HDFS".