GoogleCloudDataproc spark-bigquery-connector issues

GoogleCloudDataproc / spark-bigquery-connector

BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.

Apache License 2.0

378 stars 198 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Predicate pushdown doesn't work with DateTime BQ field - Spark 3.5, connector version 0.37

#1215 yunus closed 7 months ago
1
Error: This connector was made for Scala null, it was not meant to run on Scala 2.12

#1214 malhomaid closed 7 months ago
2
Add `createTable(TableInfo)` method to `BigQueryClient`

#1213 jphalip opened 7 months ago
0
Support OpenLineage in spark-3.x-bigquery connectors

#1212 codelixir closed 6 months ago
10
Sending Read Metrics and metadata to Spark listener

#1211 isha97 closed 7 months ago
1
How to handle column datatype change?

#1210 nandinir-db closed 5 months ago
9
java.lang.NoSuchMethodError: 'org.apache.spark.sql.catalyst.encoders.ExpressionEncoder org.apache.spark.sql.catalyst.encoders.RowEncoder.apply(org.apache.spark.sql.types.StructType)'

#1209 CatalinMihaiIonescu opened 7 months ago
6
BIGNUMERIC Precision Handling: Inaccurate Decimal Values

#1208 nabeelq closed 6 months ago
2
BigQuery Pushdown filtering on Spark 3.4.2

#1207 sid-habu opened 7 months ago
11
Issue #1195 : Support map type with complex value

#1206 isha97 closed 7 months ago
2
Sending Identity token in the read API header

#1205 isha97 closed 7 months ago
5
Storage Read API logging

#1204 kristopherkane closed 7 months ago
5
Automatically read JSON types

#1203 Guilherme-B opened 8 months ago
0
JARs marked 'latest' not being updated

#1202 dmedora closed 8 months ago
1
Fix the logging for pushdown filters

#1201 isha97 closed 8 months ago
2
Exclude shading of org.apache.commons.logging

#1200 isha97 closed 8 months ago
1
Idempotent write support in BQ

#1199 SubhamSinghal opened 8 months ago
0
Upgrade dependencies

#1198 isha97 closed 8 months ago
7
Displaying the read session id on spark UI

#1197 isha97 closed 8 months ago
11
Direct writemethod not working in Databricks for Spark 3.5

#1196 jainshasha closed 8 months ago
5
Map type with Complex Value not supported any more

#1195 walmaaoui closed 7 months ago
2
Changing the log level for read stream metrics to Info

#1194 isha97 closed 8 months ago
1
Update the format of partner attribution property

#1193 isha97 closed 8 months ago
2
Impersonate Service Account

#1192 lcaggio closed 8 months ago
1
Adding custom Metrics : Number of Read Streams per read session

#1191 isha97 closed 8 months ago
1
Enable connection sharing for at-least-once writes.

#1190 agrawal-siddharth closed 8 months ago
2
Table expiration with write() operation

#1189 mikeperello-scopely opened 9 months ago
2
Bump org.apache.commons:commons-compress from 1.25.0 to 1.26.0 in /spark-bigquery-parent

#1188 dependabot[bot] closed 9 months ago
3
Adding config to add partner attribution

#1187 isha97 closed 8 months ago
5
Issue #1182: Fix query check logic

#1186 vishalkarve15 closed 8 months ago
5
Map column of a complex type in values causes error "Data type not expected: struct<...>"

#1185 walmaaoui closed 9 months ago
1
Unable to overwrite partition

#1184 DevalNaik closed 8 months ago
3
BigQueryConnectorException: Error creating destination table

#1183 devbyaccident closed 8 months ago
5
Load failure caused by comment at top of query string (llegalArgumentException: Invalid Table ID)

#1182 bonartm closed 7 months ago
1
Add caching during protobuf generation

#1181 agrawal-siddharth closed 9 months ago
4
INVALID_ARGUMENT When attempting to show df from BigQuery

#1180 devbyaccident closed 10 months ago
3
dependency updates

#1179 davidrabinowitz closed 10 months ago
3
update dataproc versions in readme

#1178 vishalkarve15 closed 10 months ago
1
Dependency updates

#1177 davidrabinowitz closed 10 months ago
1
fix timestamp filter translation issue

#1176 vishalkarve15 closed 9 months ago
5
Schema mismatch error needs to be more verbose

#1175 vishalkarve15 closed 2 months ago
2
AWS Glue - Indirect write mode errors

#1174 adaskaval closed 9 months ago
3
adding missing changes in changes.md

#1173 isha97 closed 10 months ago
0
Clarification on Billing and Improved README.md Explanation

#1172 LakshmanKishore opened 10 months ago
1
fix read, write issues with Timestamp

#1171 vishalkarve15 closed 10 months ago
7
Flakey behavior when writing to BigQuery

#1170 imrimt closed 10 months ago
4
Support use of bigquery-emulator for integration testing

#1169 JosefNagelschmidt closed 4 days ago
8
Mark Spark33BigQueryPushdown as supporting Spark 3.4 and 3.5

#1168 tom-s-powell closed 6 months ago
4
Use debug logs for reflection errors

#1167 vishalkarve15 closed 10 months ago
1
Fix filters by adding surrounding parenthesis

#1166 tom-s-powell closed 10 months ago
7

Previous Next