I have tested this in Databricks, but I got following error. I think I was missing its dependency scalaj_http. I found out the Maven package for this is org.scala.scala-http_2.4.2. But in Databricks, it showed this was not a valid Maven coordinates. Can you suggest how to get it working?
Thank you,
java.lang.NoClassDefFoundError: scala/Product$class
at org.apache.dsext.spark.datasource.rest.RESTRelation.(RestRelation.scala:41)
at org.apache.dsext.spark.datasource.rest.RestDataSource.createRelation(RestDataSource.scala:42)
at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:365)
at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:366)
at org.apache.spark.sql.DataFrameReader.$anonfun$load$2(DataFrameReader.scala:355)
at scala.Option.getOrElse(Option.scala:189)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:355)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:240)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw$$iw$$iw$$iw.(command-3819204738235003:5)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw$$iw$$iw.(command-3819204738235003:64)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw$$iw.(command-3819204738235003:66)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw.(command-3819204738235003:68)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw.(command-3819204738235003:70)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw.(command-3819204738235003:72)
at line25a675add13d41e8b2fc53f016770f5351.$read.(command-3819204738235003:74)
at line25a675add13d41e8b2fc53f016770f5351.$read$.(command-3819204738235003:78)
at line25a675add13d41e8b2fc53f016770f5351.$read$.(command-3819204738235003)
at line25a675add13d41e8b2fc53f016770f5351.$eval$.$print$lzycompute(:7)
at line25a675add13d41e8b2fc53f016770f5351.$eval$.$print(:6)
at line25a675add13d41e8b2fc53f016770f5351.$eval.$print()
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Hi Sourav,
I have tested this in Databricks, but I got following error. I think I was missing its dependency scalaj_http. I found out the Maven package for this is org.scala.scala-http_2.4.2. But in Databricks, it showed this was not a valid Maven coordinates. Can you suggest how to get it working?
Thank you,
java.lang.NoClassDefFoundError: scala/Product$class at org.apache.dsext.spark.datasource.rest.RESTRelation.(RestRelation.scala:41)
at org.apache.dsext.spark.datasource.rest.RestDataSource.createRelation(RestDataSource.scala:42)
at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:365)
at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:366)
at org.apache.spark.sql.DataFrameReader.$anonfun$load$2(DataFrameReader.scala:355)
at scala.Option.getOrElse(Option.scala:189)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:355)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:240)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw$$iw$$iw$$iw.(command-3819204738235003:5)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw$$iw$$iw.(command-3819204738235003:64)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw$$iw.(command-3819204738235003:66)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw$$iw.(command-3819204738235003:68)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw$$iw.(command-3819204738235003:70)
at line25a675add13d41e8b2fc53f016770f5351.$read$$iw.(command-3819204738235003:72)
at line25a675add13d41e8b2fc53f016770f5351.$read.(command-3819204738235003:74)
at line25a675add13d41e8b2fc53f016770f5351.$read$.(command-3819204738235003:78)
at line25a675add13d41e8b2fc53f016770f5351.$read$.(command-3819204738235003)
at line25a675add13d41e8b2fc53f016770f5351.$eval$.$print$lzycompute(:7)
at line25a675add13d41e8b2fc53f016770f5351.$eval$.$print(:6)
at line25a675add13d41e8b2fc53f016770f5351.$eval.$print()
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)