search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.87k stars 4.07k forks source link

Sources JDBC: Change logging from INFO to DEBUG #24983

Open arditarapi opened 1 year ago

arditarapi commented 1 year ago

Tell us about the problem you're trying to solve

On SQL integrations (MySQL, Postgres, BigQuery, ..etc), we see many log entries that follow this pattern: Table {} column {} (type {}[{}], nullable {}) -> {} Table _family_file column rfam_acc (type VARCHAR[7], nullable false) -> JsonSchemaType({type=string}) In big schemas these can go more than 3000 lines.

Describe the solution you’d like

I have create a PR when i change the log from info to debug airbytehq/airbyte#24851 @marcosmarxm

Additional context

Add any other context or screenshots about the feature request here. Screenshot 2023-04-04 at 5 30 41 PM

Are you willing to submit a PR?

Yes

marcosmarxm commented 1 year ago

@airbytehq/dbsources can someone give some thoughts here?

postamar commented 9 months ago

We could certainly put in some effort to adjust the logging levels.

postamar commented 9 months ago

Closed in favour of airbytehq/airbyte-internal-issues#1663