cloudquery / plugin-sdk

CloudQuery Go SDK for source and destination plugins
Mozilla Public License 2.0
21 stars 23 forks source link

feat: Allow setting JSON type schema max depth #1844

Closed erezrokah closed 1 month ago

erezrokah commented 1 month ago

Summary

https://github.com/cloudquery/plugin-sdk/pull/1819 fixed it for the gRPC message, but it seems our backend can't handle the size of the Stripe tables.json (see https://stackoverflow.com/questions/59209884/cloud-run-request-limit). With the current default max depth of 4 it's ~40MB. Setting it to 3 lowers it to ~11MB.


Use the following steps to ensure your PR is ready to be reviewed