search

adobe / experience-platform-streaming-connect

Experience platform Streaming Connectors for Data Ingress
Apache License 2.0
24 stars 20 forks source link

Add support for http proxy #26

Closed swapdesai closed 2 years ago

swapdesai commented 3 years ago

Add support for http proxy

AEP Connector lacks support for proxy configuration

Your environment

KAFKA Version: 2.8.0 AEP Connector tag release: v0.0.6

Steps to reproduce

Within a corporate environment where all HTTP(S) connections should go over a HTTP proxy host, the AEP connector does not connect to the Adobe urls as the connector lacks support for proxy configuration and does not respect operating system proxies.

Expected behaviour

AEP Connector should accept proxy config and upon valid configuration and within proxy environment, the connector must be able to establish a connection and communicate with the Adobe urls.

Actual behaviour

AEP Connector does not connect to Adobe urls within a proxy environment

vivetiwa commented 3 years ago

@swapdesai - Have you tried with setting environment variable -Dhttps.proxyHost and -Dhttps.proxyPort to enable connector to send http request to proxy server ?

You can export httpProxy environment variables - export KAFKA_OPTS="-Dhttps.proxyHost=127.0.0.1 -Dhttps.proxyPort=8085" and then start the connector cluster - ./bin/connect-distributed.sh config/connect-distributed.properties

With above configuration connector should router to proxy server. cc @nipunnair

vivetiwa commented 2 years ago

Feature merged and deployed as part of PR - https://github.com/adobe/experience-platform-streaming-connect/pull/28 Thanks @swapdesai for the contribution!