search

samelamin / spark-bigquery

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.
Apache License 2.0
70 stars 28 forks source link

java.lang.ClassCastException: java.lang.Long cannot be cast to java.sql.Timestamp #61

Open holamap opened 6 years ago

holamap commented 6 years ago

I am trying to work with bigquery-public-data:chicago_crime.crime using spark and bigquery, and facing this exception below using samelamin/spark-bigquery package. java.lang.ClassCastException: java.lang.Long cannot be cast to java.sql.Timestamp org.apache.spark.sql.catalyst.CatalystTypeConverters$TimestampConverter$.toCatalystImpl(CatalystTypeConverters.scala:294) Is this known bug ?

samelamin commented 6 years ago

Sorry for the super late reply but I just had a daughter so was away for a bit

Seems like this is a bug yes, you can send a PR to add the missing data type here