airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.91k stars 4.09k forks source link

[source-facebook-marketing] An unexpected error occurred. Please report this if the issue persists. (HTTP 500) #38282

Closed davigs closed 1 month ago

davigs commented 5 months ago

Connector Name

source-facebook-marketing

Connector Version

2.1.8

What step the error happened?

During the sync

Relevant information

After first sync execution the connections crashed and UI crashed. Screenshot from 2024-05-16 05-52-44

Synchronization continues to run normally, but I cannot access connection details.

Relevant log output

{
  "url": "http://127.0.0.1:8000/workspaces/e485467f-c62f-473a-8c50-ff2d03442ba0/connections/27d779db-1412-49b1-9a75-e3a0c3fbfa76/status",
  "airbyteVersion": "0.57.2",
  "errorType": "HttpError",
  "errorConstructor": "g1",
  "error": {
    "i18nKey": "errors.http.internalServerError",
    "i18nParams": {
      "status": 500
    },
    "name": "HttpError",
    "requestId": "aygMht1fjGdGfuWDKgWcWs",
    "request": {
      "url": "/api/v1/jobs/list",
      "method": "post",
      "headers": {
        "Content-Type": "application/json"
      },
      "data": {
        "configId": "27d779db-1412-49b1-9a75-e3a0c3fbfa76",
        "configTypes": [
          "sync",
          "reset_connection"
        ],
        "pagination": {
          "pageSize": 3
        }
      }
    },
    "status": 500,
    "response": {
      "message": "Internal Server Error: No enum constant io.airbyte.api.model.generated.FailureType.TRANSIENT_ERROR",
      "exceptionClassName": "java.lang.IllegalArgumentException",
      "exceptionStack": [
        "java.lang.IllegalArgumentException: No enum constant io.airbyte.api.model.generated.FailureType.TRANSIENT_ERROR",
        "\tat java.base/java.lang.Enum.valueOf(Enum.java:293)",
        "\tat io.airbyte.commons.enums.Enums.convertTo(Enums.java:38)",
        "\tat io.airbyte.commons.server.converters.JobConverter.getFailureReason(JobConverter.java:247)",
        "\tat java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)",
        "\tat java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)",
        "\tat java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)",
        "\tat java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)",
        "\tat java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)",
        "\tat java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)",
        "\tat java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)",
        "\tat io.airbyte.commons.server.converters.JobConverter.getAttemptFailureSummary(JobConverter.java:229)",
        "\tat io.airbyte.commons.server.converters.JobConverter.getAttemptRead(JobConverter.java:178)",
        "\tat java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)",
        "\tat java.base/java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:357)",
        "\tat java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:510)",
        "\tat java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)",
        "\tat java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:575)",
        "\tat java.base/java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)",
        "\tat java.base/java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:616)",
        "\tat java.base/java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:622)",
        "\tat java.base/java.util.stream.ReferencePipeline.toList(ReferencePipeline.java:627)",
        "\tat io.airbyte.commons.server.converters.JobConverter.getJobWithAttemptsRead(JobConverter.java:106)",
        "\tat java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)",
        "\tat java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1708)",
        "\tat java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)",
        "\tat java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)",
        "\tat java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)",
        "\tat java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)",
        "\tat java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)",
        "\tat io.airbyte.commons.server.handlers.JobHistoryHandler.listJobsFor(JobHistoryHandler.java:167)",
        "\tat io.airbyte.server.apis.JobsApiController.lambda$listJobsFor$13(JobsApiController.java:188)",
        "\tat io.airbyte.server.apis.ApiHelper.execute(ApiHelper.java:28)",
        "\tat io.airbyte.server.apis.JobsApiController.listJobsFor(JobsApiController.java:188)",
        "\tat io.airbyte.server.apis.$JobsApiController$Definition$Exec.dispatch(Unknown Source)",
        "\tat io.micronaut.context.AbstractExecutableMethodsDefinition$DispatchedExecutableMethod.invokeUnsafe(AbstractExecutableMethodsDefinition.java:461)",
        "\tat io.micronaut.context.DefaultBeanContext$BeanContextUnsafeExecutionHandle.invokeUnsafe(DefaultBeanContext.java:4276)",
        "\tat io.micronaut.web.router.AbstractRouteMatch.execute(AbstractRouteMatch.java:271)",
        "\tat io.micronaut.http.server.RouteExecutor.executeRouteAndConvertBody(RouteExecutor.java:488)",
        "\tat io.micronaut.http.server.RouteExecutor.lambda$callRoute$6(RouteExecutor.java:465)",
        "\tat io.micronaut.core.execution.ExecutionFlow.lambda$async$1(ExecutionFlow.java:87)",
        "\tat io.micronaut.core.propagation.PropagatedContext.lambda$wrap$3(PropagatedContext.java:211)",
        "\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)",
        "\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)",
        "\tat java.base/java.lang.Thread.run(Thread.java:1583)"
      ]
    }
  },
  "stacktrace": "HttpError: errors.http.internalServerError\n    at Wie (http://127.0.0.1:8000/assets/WorkspaceAccessManagementSection-wlzRRC7f.js:69:7330)",
  "userAgent": "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36",
  "featureFlags": {}
}

Contribute

marcosmarxm commented 5 months ago

There seems to be an issue with the Airbyte API. Could you please provide more details on how you are setting up the server, your operating system, and server resources? Also, consider upgrading to the latest version if possible. Is this happennig to all connections or only this one?

davigs commented 4 months ago

Hi @marcosmarxm, This problem happen only facebook connection. I'm running airbyte on ubuntu linux, the machine is CPU rayzen 8600G, 128GB ram and 1TB nvme. I've others connections and execute with successfully. The airbyte is on the version 0.57.2, I will update for the latest version.

pmossman commented 3 months ago

@davigs did updating to the latest version of Airbyte resolve this issue? One hypothesis is that a connector started emitting a new failure type that your current platform version was not aware of yet.

timroes commented 1 month ago

Closing this issue due to inactivity.

We are trying to keep our issues to a manageable amount, which means we are trying to close issues we cannot reproduce or gather required information for some time. Please feel free to still provide the requested information in case the issue still persists in the most recent version. We will gladly reopen this issue again.