search

prafulbhise / BigdataExpert

2 stars 0 forks source link

validate the data in TD using spark #3

Closed prafulbhise closed 5 years ago

prafulbhise commented 5 years ago

val sqlcontext=new org.apache.spark.sql.SQLContext(sc) val spark_pk = sqlcontext.load("jdbc",Map("url" -> "jdbc:teradata://TD_HOSTNAME/,TMODE=ANSI,CHARSET=UTF8,user=,password=","dbtable" -> "(select count(*) as cnt from DB.TABLE) AS ST", "driver" -> "com.teradata.jdbc.TeraDriver"))

prafulbhise commented 5 years ago

it's been working and fixed