GoogleCloudDataproc spark-bigquery-connector issues

GoogleCloudDataproc / spark-bigquery-connector

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Apache License 2.0

378 stars 198 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Add additional parentheses for EqualNullSafe filter generation

#1265 tom-s-powell closed 2 months ago
2
Failed to write into bigquery using spark 3.2.1

#1264 krishna00000785 closed 4 months ago
2
"ClusteredFields" creation not supported in Direct write method from Pyspark to BigQuery

#1263 deena10545 closed 3 months ago
2
Big Query Full Table Read - Some Partitions take longer bqScanTime as compared to other partitions with similar number of records

#1262 josepaul1988 closed 4 months ago
4
Adding IdentityToken header in readRows call

#1261 isha97 closed 4 months ago
4
proxyAddress variable is not used if default application credentials method is used

#1260 milicevica23 closed 3 months ago
4
Encode snapshotTimeMillis in view materialization query

#1259 tom-s-powell closed 4 months ago
2
Issue #1254: fix getting partitioning fields for pseudo columns

#1258 vishalkarve15 closed 3 months ago
5
Unable to write decimal values with scale > 9 to bigquery using dataproc and spark bigquery connector.

#1257 abhilash499 closed 3 months ago
2
NullPointerException - Error creating destination table using the following query

#1256 srikanthnagidi closed 4 months ago
2
LoadingCache for identity token supplier

#1255 isha97 closed 4 months ago
0
NullPointerException when using Java connector with time partitioned tables

#1254 rafalh closed 3 months ago
3
Make BigQueryClientFactory Kryo serializable.

#1253 davidrabinowitz closed 2 months ago
2
Viewing connector metrics

#1252 Swebask closed 4 months ago
4
Add equals and hashcode in IdentityTokenSupplier

#1251 isha97 closed 4 months ago
2
Issue #1043: fixed indirect write overwrite dropping policy tags

#1250 vishalkarve15 closed 4 months ago
3
Issue #1244, Issue #1043 Use existing field properties and only update as per ALLOW_FIELD_RELAXATION

#1249 isha97 closed 4 months ago
10
Update Changes for 0.39.1 release

#1248 isha97 closed 5 months ago
0
Disable internal-ip-only for acceptance test clusters

#1247 isha97 closed 5 months ago
1
Permission bigquery.tables.create required on already materialised view

#1246 k-charalampous closed 5 months ago
1
Use SessionState to obtain Hadoop configuration

#1245 tom-s-powell opened 5 months ago
0
Disable Schema Changes

#1244 gmiano closed 4 months ago
2
Issue #1126: Making SparkBigQueryConfig Kryo compatible

#1243 davidrabinowitz closed 5 months ago
2
Spark BQ connector unable to handle timestamps - 0001-01-01 00:00:00

#1242 Murli16 closed 4 months ago
3
Shading updates for release 0.39.1

#1241 davidrabinowitz closed 5 months ago
1
Issue #1223: gRPC status creates 'object not serializable' errors

#1240 davidrabinowitz closed 5 months ago
1
Allow GCS bucket to be supplied including a scheme

#1239 tom-s-powell closed 5 months ago
1
Fix the log message regarding number of partitions received from read…

#1238 isha97 closed 5 months ago
0
BigQuery Storage API always returning 200 partitions

#1237 rcanzanese closed 5 months ago
1
Adding shading verification

#1236 davidrabinowitz closed 5 months ago
5
Relocate net.bytebuddy:bytebuddy dependency

#1235 tom-s-powell closed 5 months ago
1
BigNumeric precision is too wide (76), Spark can only handle decimal types with max precision of 38

#1234 John15321 closed 5 months ago
6
Configuring DataProc Cluster to Publish BigQuery Metrics on GCP

#1233 gmiano opened 6 months ago
1
Indirect write to existing datetime column not possible

#1232 cheare closed 6 months ago
2
Upgrade dependencies

#1231 isha97 closed 6 months ago
2
Updating the Changes file

#1230 davidrabinowitz closed 6 months ago
1
TIMESTAMP appears to add an hour compared to DATETIME

#1229 Naboo22 closed 6 months ago
2
Unable to write to a partitioned table in spark 3.5 with connector version spark-3.4-bigquery-0.34.0

#1228 hierr closed 5 months ago
6
Optimized MERGE query for dynamic partition overwrite in Time partitioned table

#1227 isha97 closed 6 months ago
2
PySpark virtualenv: Missing dependencies lead to No FileSystem for scheme "gs"

#1226 GuiBou165 closed 6 months ago
3
Fix multi-release jar shading

#1225 vishalkarve15 closed 6 months ago
3
Request to Stop Enforcing Delete Permissions on Materialization Dataset

#1224 reynoldspravindev closed 3 months ago
1
error while writing with many timestamp data

#1223 iqbalaey closed 6 months ago
0
add option to request lz4 compressed ReadRowsResponse

#1222 yqiu2 closed 6 months ago
5
Add config option for snapshot time

#1221 tom-s-powell closed 6 months ago
1
Upgrade dependencies

#1220 isha97 closed 6 months ago
6
Remove spark 2.4 connector from the release

#1219 isha97 closed 6 months ago
3
Publishing write session metrics from connector

#1218 isha97 closed 6 months ago
5
Update Changes for next release

#1217 isha97 closed 7 months ago
0
Support predicate pushdown for DATETIME

#1216 isha97 closed 7 months ago
1

Previous Next