Closed XavierZYXue closed 5 days ago
due to this PR break the SparkBigQueryConfig into two classes.
Amazing! Unfortunately due to zero capacity of the team I cannot promise any ETA of the fix. But if you could create a PR we would happily accept it and release an updated version of the agent.
@wajda hi, I have tested in my local environment. It's passed. Could you please reivew this #823 for this bugfix?
I encounterd an exception as following when I tried to send Spark's lineage message to Kafka cluster.
Then, I went to check the commits history records of BigQueryPlugin.scala. I found that there has always been a check for whether the number of parameter types equals 7, right after the initial commit.
Hence, base on the prompt, I go to SparkBigQueryConfig.java and check the commits history records as following: v0.25.0 v0.25.1
Base on the above commits history, it indeed provides a static SparkBigQueryConfig with 7 args before version 0.25.0, but it was changed after 0.25.0. Therefore, you will encounter this error if you use the version after this version.