Closed sujeet100 closed 4 years ago
Thanks for the PR! 👍
Is this released in latest version?
It should be yes
Seems like it is not released in latest version. Could you please tell which version to use?
@samelamin Seems like 0.2.6 is the latest one available in maven repo. https://repo1.maven.org/maven2/com/github/samelamin/spark-bigquery_2.11/ Could you please publish a new version of the library?
No Worries i will do that this weekend hopefully
This pull requests fixed the bug #56 When bigquery returns empty result then the bigQuerySelect throws an exception while trying to figure out the schema.
Check if data is empty before converting dataframe using schema else return empty dataframe. the isEmpty() check cannot be done directly on the RDD as it fails with serialization issue. Hence the isEmpty() check is applied after map operation to schema.