airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.67k stars 4.02k forks source link

[source-jira] throws 401 error when using custom domain #33577

Open mahesh-chaudhary opened 9 months ago

mahesh-chaudhary commented 9 months ago

Connector Name

source-jira

Connector Version

0.11.0

What step the error happened?

Configuring a new connector

Relevant information

Airbyte Version installed locally : 0.50.35

Jira default connector version it uses : 0.11.0

I am working on POC to explore airbyte where I need to connect to company hosted JIRA cloud instance. So the URL format : JIRA..CLOUD

I have installed airbyte on my local machine which is using VPN to connect to company network. I am able to get successful json response using postman for the same api call and api key which I am using for airbyte JIRA source connection. Using UI front of airbyte jira connector I get 401 error, detailed error log is pasted in log output section.

PS: I am inside company VPN to connect via postman(where response is successful) as well as my localhost setup of airbyte(Here response is 401 error).

Relevant log output

Configuration check failed
Config validation error: Invalid creds were provided, please check your api token, domain and/or email.

Learn more
Internal message: 401 Client Error: for url: https://jira.<domain_name>.cloud/rest/api/3/label?maxResults=50
Failure origin: source
Failure type: config_error

<-------STACKTRACE ----->

requests.exceptions.HTTPError: 401 Client Error:  for url: https://jira.<domain_name>.cloud/rest/api/3/label?maxResults=50
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/airbyte/integration_code/main.py", line 13, in <module>
    launch(source, sys.argv[1:])
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 210, in launch
    for message in source_entrypoint.run(parsed_args):
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 110, in run
    yield from map(AirbyteEntrypoint.airbyte_message_to_string, self.check(source_spec, config))
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 134, in check
    check_result = self.source.check(self.logger, config)
  File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 82, in check
    check_succeeded, error = self.check_connection(logger, config)
  File "/airbyte/integration_code/source_jira/source.py", line 97, in check_connection
    next(read_full_refresh(labels_stream), None)
  File "/airbyte/integration_code/source_jira/utils.py", line 23, in read_full_refresh
    for record in records:
  File "/airbyte/integration_code/source_jira/streams.py", line 109, in read_records
    raise AirbyteTracedException(
airbyte_cdk.utils.traced_exception.AirbyteTracedException: 401 Client Error:  for url: https://jira.<domain_name>.cloud/rest/api/3/label?maxResults=50

Contribute

marcosmarxm commented 9 months ago

Did you try to ingest other streams or only labels? The domain or endpoint is correct? (the same you're using Postman?)

mahesh-chaudhary commented 9 months ago

Did you try to ingest other streams or only labels? - Do you mean to connect to other sources ?

The domain or endpoint is correct? (the same you're using Postman?) - Yes The same domain which Airbyte is trying to connect , I tried same with Postman and it was giving me successfule response

mahesh-chaudhary commented 6 months ago

Any update on this would be appreciated

marcosmarxm commented 6 months ago

Sorry the lack of updates @mahesh-chaudhary the issue still in the team backlog.