Issue #1254: fix getting partitioning fields for pseudo columns - Githubissues

GoogleCloudDataproc / spark-bigquery-connector

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Apache License 2.0

378 stars 198 forks source link

Issue #1254: fix getting partitioning fields for pseudo columns #1258

Closed vishalkarve15 closed 3 months ago

vishalkarve15 commented 4 months ago

When getting partitioning fields, timePartitioning.getField() returns null when the table is ingestion time partitioned (partitioned by _PARTITIONTIME OR _PARTITIONDATE). The change fixes this bug.

vishalkarve15 commented 4 months ago

/gcbrun

vishalkarve15 commented 4 months ago

/gcbrun

vishalkarve15 commented 4 months ago

Added integration tests which fail as expected without the fix.

vishalkarve15 commented 4 months ago

/gcbrun

vishalkarve15 commented 4 months ago

/gcbrun