search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.72k stars 3.78k forks source link

v0.63.0 Unexpected error occurred: No enum constant io.airbyte.api.client.model.generated.JobStatus.running #39482

Open descampsk opened 2 weeks ago

descampsk commented 2 weeks ago

Platform Version

v0.63.0

What step the error happened?

Other

Relevant information

Deployed via https://raw.githubusercontent.com/airbytehq/airbyte/v0.63.0/run-ab-platform.sh with my own database.

Occured after an upgrade from the version 0.61.0

When calling http://airbyte.dev.gcp.internal:8006/v1/jobs?connectionId=e3c6eec3-7240-490a-95be-eb58ea635fb1&status=running

But I have also a 400 error on http://airbyte.dev.gcp.internal:8006/v1/jobs?connectionId=e3c6eec3-7240-490a-95be-eb58ea635fb1 which is maybe related

Relevant log output

Error 500

2024-06-14 09:21:09 ERROR i.m.h.s.RouteExecutor(logException):282 - Unexpected error occurred: No enum constant io.airbyte.api.client.model.generated.JobStatus.running
java.lang.IllegalArgumentException: No enum constant io.airbyte.api.client.model.generated.JobStatus.running
        at java.base/java.lang.Enum.valueOf(Enum.java:293) ~[?:?]
        at io.airbyte.api.client.model.generated.JobStatus.valueOf(JobStatus.kt) ~[io.airbyte-airbyte-api-0.63.0.jar:?]
        at io.airbyte.api.server.filters.JobsFilter.getConfigApiStatus(JobsFilter.kt:43) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
        at io.airbyte.api.server.services.JobServiceImpl.getJobList(JobService.kt:263) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
        at io.airbyte.api.server.controllers.JobsController.listJobs$lambda$6(JobsController.kt:248) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
        at io.airbyte.api.server.apiTracking.TrackingHelper.callWithTracker(TrackingHelper.kt:107) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
        at io.airbyte.api.server.controllers.JobsController.listJobs(JobsController.kt:246) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
        at io.airbyte.api.server.controllers.$JobsController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
        at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461) ~[micronaut-inject-4.4.10.jar:4.4.10]
        at io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4232) ~[micronaut-inject-4.4.10.jar:4.4.10]
        at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:271) ~[micronaut-router-4.4.10.jar:4.4.10]
        at io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:488) ~[micronaut-http-server-4.4.10.jar:4.4.10]
        at io.micronaut.http.server.RouteExecutor.lambda$callRoute$6(RouteExecutor.java:465) ~[micronaut-http-server-4.4.10.jar:4.4.10]
        at io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87) ~[micronaut-core-4.4.10.jar:4.4.10]
        at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.4.10.jar:4.4.10]
        at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.4.10.jar:4.4.10]
        at java.base/java.util.concurrent.ThreadPerTaskExecutor$TaskRunner.run(ThreadPerTaskExecutor.java:314) ~[?:?]

Error 400 : 

2024-06-14 09:21:18 ERROR i.a.a.s.s.JobServiceImpl(getJobList):224 - Config api response error for getJobList: 
io.micronaut.http.client.exceptions.HttpClientResponseException: Bad Request
        at io.micronaut.http.client.netty.DefaultHttpClient$FullHttpResponseHandler.makeErrorFromRequestBody(DefaultHttpClient.java:2259) ~[micronaut-http-client-4.4.10.jar:4.4.10]
        at io.micronaut.http.client.netty.DefaultHttpClient$FullHttpResponseHandler.forwardResponseToPromise(DefaultHttpClient.java:2210) ~[micronaut-http-client-4.4.10.jar:4.4.10]
        at io.micronaut.http.client.netty.DefaultHttpClient$FullHttpResponseHandler.channelReadInstrumented(DefaultHttpClient.java:2179) ~[micronaut-http-client-4.4.10.jar:4.4.10]
        at io.micronaut.http.client.netty.DefaultHttpClient$FullHttpResponseHandler.channelReadInstrumented(DefaultHttpClient.java:2147) ~[micronaut-http-client-4.4.10.jar:4.4.10]
        at io.micronaut.http.client.netty.SimpleChannelInboundHandlerInstrumented.channelRead0(SimpleChannelInboundHandlerInstrumented.java:46) ~[micronaut-http-client-4.4.10.jar:4.4.10]
        at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[netty-codec-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103) ~[netty-codec-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) ~[netty-codec-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) ~[netty-codec-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.ChannelInboundHandlerAdapter.channelRead(ChannelInboundHandlerAdapter.java:93) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.micronaut.http.client.netty.ResettableReadTimeoutHandler$NextInterceptor.channelRead(ResettableReadTimeoutHandler.java:92) ~[micronaut-http-client-4.4.10.jar:4.4.10]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:289) ~[netty-handler-4.1.110.Final.jar:4.1.110.Final]
        at io.micronaut.http.client.netty.ResettableReadTimeoutHandler.channelRead(ResettableReadTimeoutHandler.java:64) ~[micronaut-http-client-4.4.10.jar:4.4.10]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1407) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:918) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) ~[netty-transport-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:994) ~[netty-common-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.110.Final.jar:4.1.110.Final]
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.110.Final.jar:4.1.110.Final]
        at java.base/java.lang.Thread.run(Thread.java:1583) ~[?:?]
        Suppressed: java.lang.Exception: #block terminated with an error
                at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:104) ~[reactor-core-3.6.5.jar:3.6.5]
                at reactor.core.publisher.Flux.blockFirst(Flux.java:2766) ~[reactor-core-3.6.5.jar:3.6.5]
                at io.micronaut.http.client.netty.DefaultHttpClient$1.exchange(DefaultHttpClient.java:571) ~[micronaut-http-client-4.4.10.jar:4.4.10]
                at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.lambda$handleSynchronous$1(HttpClientIntroductionAdvice.java:233) ~[micronaut-http-client-core-4.4.10.jar:4.4.10]
                at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.handleBlockingCall(HttpClientIntroductionAdvice.java:620) ~[micronaut-http-client-core-4.4.10.jar:4.4.10]
                at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.handleSynchronous(HttpClientIntroductionAdvice.java:232) ~[micronaut-http-client-core-4.4.10.jar:4.4.10]
                at io.micronaut.http.client.interceptor.HttpClientIntroductionAdvice.intercept(HttpClientIntroductionAdvice.java:195) ~[micronaut-http-client-core-4.4.10.jar:4.4.10]
                at io.micronaut.aop.chain.MethodInterceptorChain.proceed(MethodInterceptorChain.java:138) ~[micronaut-aop-4.4.10.jar:4.4.10]
                at io.airbyte.api.server.forwardingClient.ConfigApiClient$Intercepted.getJobList(Unknown Source) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
                at io.airbyte.api.server.services.JobServiceImpl.getJobList(JobService.kt:222) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
                at io.airbyte.api.server.controllers.JobsController.listJobs$lambda$5(JobsController.kt:232) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
                at io.airbyte.api.server.apiTracking.TrackingHelper.callWithTracker(TrackingHelper.kt:107) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
                at io.airbyte.api.server.controllers.JobsController.listJobs(JobsController.kt:230) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
                at io.airbyte.api.server.controllers.$JobsController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-api-server-0.63.0.jar:?]
                at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461) ~[micronaut-inject-4.4.10.jar:4.4.10]
                at io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4232) ~[micronaut-inject-4.4.10.jar:4.4.10]
                at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:271) ~[micronaut-router-4.4.10.jar:4.4.10]
                at io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:488) ~[micronaut-http-server-4.4.10.jar:4.4.10]
                at io.micronaut.http.server.RouteExecutor.lambda$callRoute$6(RouteExecutor.java:465) ~[micronaut-http-server-4.4.10.jar:4.4.10]
                at io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87) ~[micronaut-core-4.4.10.jar:4.4.10]
                at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.4.10.jar:4.4.10]
                at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.4.10.jar:4.4.10]
                at java.base/java.util.concurrent.ThreadPerTaskExecutor$TaskRunner.run(ThreadPerTaskExecutor.java:314) ~[?:?]
descampsk commented 2 weeks ago

This error is reproductible with the launcher script : 

# clone Airbyte from GitHub
git clone --depth=1 https://github.com/airbytehq/airbyte.git

# switch into Airbyte directory
cd airbyte

# start Airbyte
./run-ab-platform.sh

# GET jobs
curl http://airbyte:password@localhost:8006/v1/jobs?workspaceIds=688993b4-a749-4360-b372-1289600851e9&status=running

{"type":"about:blank","status":500}
descampsk commented 1 week ago

Still in v0.63.1

aliellis commented 1 week ago

Just updated to v0.63.1 and hitting the same issue

from the logs:

2024-06-20 16:07:11 ERROR i.m.h.s.RouteExecutor(logException):282 - Unexpected error occurred: No enum constant io.airbyte.api.client.model.generated.JobStatus.incomplete
java.lang.IllegalArgumentException: No enum constant io.airbyte.api.client.model.generated.JobStatus.incomplete
    at java.base/java.lang.Enum.valueOf(Enum.java:293) ~[?:?]
    at io.airbyte.api.client.model.generated.JobStatus.valueOf(JobStatus.kt) ~[io.airbyte-airbyte-api-0.63.1.jar:?]
    at io.airbyte.api.server.filters.JobsFilter.getConfigApiStatus(JobsFilter.kt:43) ~[io.airbyte-airbyte-api-server-0.63.1.jar:?]
    at io.airbyte.api.server.services.JobServiceImpl.getJobList(JobService.kt:211) ~[io.airbyte-airbyte-api-server-0.63.1.jar:?]
    at io.airbyte.api.server.controllers.JobsController.listJobs$lambda$5(JobsController.kt:232) ~[io.airbyte-airbyte-api-server-0.63.1.jar:?]
    at io.airbyte.api.server.apiTracking.TrackingHelper.callWithTracker(TrackingHelper.kt:107) ~[io.airbyte-airbyte-api-server-0.63.1.jar:?]
    at io.airbyte.api.server.controllers.JobsController.listJobs(JobsController.kt:230) ~[io.airbyte-airbyte-api-server-0.63.1.jar:?]
    at io.airbyte.api.server.controllers.$JobsController$Definition$Exec.dispatch(Unknown Source) ~[io.airbyte-airbyte-api-server-0.63.1.jar:?]
    at io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461) ~[micronaut-inject-4.4.10.jar:4.4.10]
    at io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4232) ~[micronaut-inject-4.4.10.jar:4.4.10]
    at io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:271) ~[micronaut-router-4.4.10.jar:4.4.10]
    at io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:488) ~[micronaut-http-server-4.4.10.jar:4.4.10]
    at io.micronaut.http.server.RouteExecutor.lambda$callRoute$6(RouteExecutor.java:465) ~[micronaut-http-server-4.4.10.jar:4.4.10]
    at io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87) ~[micronaut-core-4.4.10.jar:4.4.10]
    at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.4.10.jar:4.4.10]
    at io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211) ~[micronaut-core-4.4.10.jar:4.4.10]
    at java.base/java.util.concurrent.ThreadPerTaskExecutor$TaskRunner.run(ThreadPerTaskExecutor.java:314) ~[?:?]
    at java.base/java.lang.VirtualThread.run(VirtualThread.java:309) ~[?:?]

This happens for all statuses, not just incomplete

descampsk commented 1 week ago

Still in v0.63.2