We are now running on Beam SDK version 2.42.0 which is deprecated.
Bumping sdk version breaks our build (see https://github.com/mozilla/gcp-ingestion/pull/2484 and previous PRs opened by Dependabot). Immediate reason of this breakage is removal of google-http-client-jackson2 dependency which was transitively imported with google-cloud-bigquery and removed in version 2.21.
I tried two approaches for fixing the build with updated SDK so far:
We are now running on Beam SDK version 2.42.0 which is deprecated.
Bumping sdk version breaks our build (see https://github.com/mozilla/gcp-ingestion/pull/2484 and previous PRs opened by Dependabot). Immediate reason of this breakage is removal of
google-http-client-jackson2dependency which was transitively imported withgoogle-cloud-bigqueryand removed in version 2.21.I tried two approaches for fixing the build with updated SDK so far:
google-http-client-jackson2dependency to ingestion-coreBoth make the code compile but some tests are failing, probably caused by differences in how Jackson and Gson parse JSON.