Low code CDK: Http proxy support

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

https://airbyte.com

Other

16.28k stars 4.15k forks source link

Low code CDK: Http proxy support #27192

Open flash1293 opened 1 year ago

flash1293 commented 1 year ago

What area the feature impact?

None

Revelant Information

In some cases Airbyte is running in a locked down network and needs to connect to the outside world via http proxy.

This should be configurable.

One possible design:

Add proxy settings to the http requester (proxy url and auth)
In the builder, allow to check a box "allow http settings"
When the setting is activated, inferred http proxy user inputs are added

flash1293 commented 1 year ago

+1 from connector builder webinar

matheuzinoficial commented 1 year ago

Up! I really need this feature because some resources need a proxy to work. For example, some services here in Brazil can only be accessed by servers residing here in our country. So when my server is in US and I can't use a proxy to access it, I simply can't lol.