vectordotdev / vector

A high-performance observability data pipeline.
https://vector.dev
Mozilla Public License 2.0
17.5k stars 1.53k forks source link

GCP PubSub Sources does not connect through proxy #16956

Open zorel opened 1 year ago

zorel commented 1 year ago

A note for the community

Problem

Hello.

I'm running vector inside a proxyfied environment. I run with this global parameters:

proxy.enabled = true
proxy.http = "http://fpc:8080"
proxy.https = "http://fpc:8080"
proxy.no_proxy = "localhost,127.0.0.1"

And with this env variables:

# set | grep proxy
http_proxy=http://fpc:8080
https_proxy=http://fpc:8080
no_proxy=localhost,127.0.0.1

And vector, while starting correctly and doing the oauth token creation with GCP, tries to connect to something without using proxy:

[root@dv vector]# ss -antp | grep vector
LISTEN     0      128        127.0.0.1:8686        0.0.0.0:*     users:(("vector",pid=3021583,fd=10))
SYN-SENT   0      1      <localip>:37350  199.36.153.8:443   users:(("vector",pid=3021583,fd=9))

The IP 199.36 is for private access to GCP services.

Configuration

No response

Version

vector 0.28.1 (x86_64-unknown-linux-gnu ff15924 2023-03-06)

Debug Output

No response

Example Data

No response

Additional Context

No response

References

No response

neuronull commented 1 year ago

Checking the code for the GCP pubsub source, it indeed looks like we are not using the proxy from the SourceContext.