search

adobe / experience-platform-streaming-connect

Experience platform Streaming Connectors for Data Ingress
Apache License 2.0
23 stars 20 forks source link

Proxy support not supporting all Adobe URLs #30

Closed swapdesai closed 2 years ago

swapdesai commented 2 years ago

Subject of the issue

Proxy support not supporting all Adobe URLs

Your environment

KAFKA Version: 2.8.0 AEP Connector tag release: v0.0.8

Steps to reproduce

Within a corporate environment where all HTTP(S) connections should go over a HTTP proxy host, the AEP connector does connect to only certain Adobe urls.

Expected behaviour

The connector must be able to establish a connection and communicate with all the Adobe urls.

Actual behaviour

AEP Connector does not connect to all Adobe urls within a proxy environment.

swapdesai commented 2 years ago

Logs for reference [2021-10-27 09:49:14,369] DEBUG **opening connection for: https://dcs.adobedc.net**/collection/batch/2b64745acab7b81d13a3feb16d85c0464447f1972dd0422f8aa31452568915b5 (com.adobe.platform.streaming.http.HttpConnection:85) [2021-10-27 09:49:14,369] DEBUG proxyHost: proxyHost, proxyPort: 8989 (com.adobe.platform.streaming.http.HttpConnection:101) [2021-10-27 09:49:14,588] DEBUG refreshing expired jwtToken: aa5ca090fb5b42a6b8d5b1adaf3fa308 (com.adobe.platform.streaming.auth.impl.JWTTokenProvider:84) [2021-10-27 09:49:14,861] INFO in init: https://ims-na1.adobelogin.com (com.adobe.platform.streaming.http.HttpProducer:48) [2021-10-27 09:49:14,862] DEBUG **opening connection for: https://ims-na1.adobelogin.com**/ims/exchange/jwt/ (com.adobe.platform.streaming.http.HttpConnection:85) [2021-10-27 09:49:14,862] DEBUG **outside isBasicProxyConfigured** (com.adobe.platform.streaming.http.HttpConnection:105) [2021-10-27 09:49:14,862] DEBUG conn: sun.net.www.protocol.https.DelegateHttpsURLConnection:https://clicktime.symantec.com/3WaiozYo7jJdsARou2fyRPb7Vc?u=https%3A%2F%2Fims-na1.adobelogin.com%2Fims%2Fexchange%2Fjwt%2F (com.adobe.platform.streaming.http.HttpConnection:109)

swapdesai commented 2 years ago

The connector does use the proxy configuration when establishing a connection to the endpoint https://dcs.adobedc.net but does not for the endpoint https://ims-na1.adobelogin.com

vivetiwa commented 2 years ago

Fix done as part of PR https://github.com/adobe/experience-platform-streaming-connect/pull/31