airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.19k stars 4.14k forks source link

[source-freshdesk] `skills` stream throws 404 error #36226

Open HarishPetavue opened 8 months ago

HarishPetavue commented 8 months ago

Connector Name

source-freshdesk

Connector Version

3.0.7

What step the error happened?

During the sync

Relevant information

Hello,

When i try to sync skills object from freshdesk to postgres, im getting 404 error.

Relevant log output

File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://*.freshdesk.com/api/v2/skills?per_page=100
,retryable=<null>,timestamp=1710747486672,additionalProperties={}], io.airbyte.config.FailureReason@4b5a9f2e[failureOrigin=source,failureType=<null>,internalMessage=Source didn't exit properly - check the logs!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@16bd7d8[additionalProperties={attemptNumber=2, jobId=9458678, connector_command=read}],stacktrace=io.airbyte.workers.internal.exception.SourceException: Source didn't exit properly - check the logs!
        at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$8(DefaultReplicationWorker.java:367)
        at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.
        at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:173)
        at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$8(DefaultReplicationWorker.java:365)
        ... 4 more
,retryable=<null>,timestamp=1710747487762,additionalProperties={}]],additionalProperties={}]

Contribute

marcosmarxm commented 8 months ago

@HarishPetavue are you able to run this request manually? Freshdesk doesn't have an error page to explain possible causes.

HarishPetavue commented 8 months ago

@marcosmarxm Seems the issue with freshdesk api itself, i think its better till freshdesk fix the issue the skill object should not be synced, it stopping the entire sync.

marcosmarxm commented 8 months ago

Thanks, please disable the skills stream. I'm going to share this to the team.