search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.22k stars 4.14k forks source link

workload-launcher pod fails with SocketException: operation not permitted #44024

Open hanslemm opened 3 months ago

hanslemm commented 3 months ago

Helm Chart Version

0.399.0

What step the error happened?

On deploy

Relevant information

The workload-launcher pod fails on specific deployments where it needs to wait longer for other pods with SocketException: Operation not permitted.

Relevant log output

ERROR i.a.w.l.StartupApplicationEventListener$onApplicationEvent$1(invoke):41 - rehydrateAndProcessClaimed failed
dev.failsafe.FailsafeException: java.net.SocketException: Operation not permitted
    at dev.failsafe.SyncExecutionImpl.executeSync(SyncExecutionImpl.java:196) ~[failsafe-3.3.2.jar:3.3.2]
    at dev.failsafe.FailsafeExecutor.call(FailsafeExecutor.java:376) ~[failsafe-3.3.2.jar:3.3.2]
    at dev.failsafe.FailsafeExecutor.get(FailsafeExecutor.java:112) ~[failsafe-3.3.2.jar:3.3.2]
    at io.airbyte.workload.launcher.ClaimedProcessor.getWorkloadList(ClaimedProcessor.kt:111) ~[io.airbyte-airbyte-workload-launcher-0.63.15.jar:?]
    at io.airbyte.workload.launcher.ClaimedProcessor.retrieveAndProcess(ClaimedProcessor.kt:60) ~[io.airbyte-airbyte-workload-launcher-0.63.15.jar:?]
    at io.airbyte.workload.launcher.StartupApplicationEventListener$onApplicationEvent$1.invoke(StartupApplicationEventListener.kt:37) [io.airbyte-airbyte-workload-launcher-0.63.15.jar:?]
    at io.airbyte.workload.launcher.StartupApplicationEventListener$onApplicationEvent$1.invoke(StartupApplicationEventListener.kt:35) [io.airbyte-airbyte-workload-launcher-0.63.15.jar:?]
    at kotlin.concurrent.ThreadsKt$thread$thread$1.run(Thread.kt:30) [kotlin-stdlib-1.9.24.jar:1.9.24-release-822]
hanslemm commented 3 months ago

Fix proposal here https://github.com/airbytehq/airbyte-platform/pull/350

marcosmarxm commented 2 months ago

Thanks for the contribution @hanslemm lets wait for the review and resolution of your pull request.