appsmithorg / appsmith

Platform to build admin panels, internal tools, and dashboards. Integrates with 25+ databases and any API.
https://www.appsmith.com
Apache License 2.0
34.75k stars 3.76k forks source link

[Bug] Run details is failing with server timeout for large runs with big input to the query params #36009

Open infinitetrooper opened 3 months ago

infinitetrooper commented 3 months ago

I have a workflow that is inserting 1000 rows of data into a Postgres db 1000 times. The workflow failed after 437000 rows inserted but the run details of that run is not opening.

image

This is the temporal error {"level":"error","ts":"2024-08-30T10:01:32.637Z","msg":"Fail to process task","shard-id":3,"address":"172.18.0.2:7234","component":"transfer-queue-processor","wf-namespace-id":"a68a48fe-7837-4ac4-b017-555456d1a6d3","wf-id":"XXCRLR1J","wf-run-id":"48299733-1a29-492a-a00d-41713c4fc096","queue-task-id":47193722,"queue-task-visibility-timestamp":"2024-08-30T10:01:32.586Z","queue-task-type":"TransferActivityTask","queue-task":{"NamespaceID":"a68a48fe-7837-4ac4-b017-555456d1a6d3","WorkflowID":"XXCRLR1J","RunID":"48299733-1a29-492a-a00d-41713c4fc096","VisibilityTimestamp":"2024-08-30T10:01:32.586925008Z","TaskID":47193722,"TaskQueue":"appsmith-queue","ScheduledEventID":2633,"Version":0},"wf-history-event-id":2633,"error":"Workflow history size / count exceeds limit.","lifecycle":"ProcessingFailed","logging-call-at":"lazy_logger.go:68","stacktrace":"go.temporal.io/server/common/log.(*zapLogger).Error\n\t/home/runner/work/temporal/temporal/common/log/zap_logger.go:156\ngo.temporal.io/server/common/log.(*lazyLogger).Error\n\t/home/runner/work/temporal/temporal/common/log/lazy_logger.go:68\ngo.temporal.io/server/service/history/queues.(*executableImpl).HandleErr\n\t/home/runner/work/temporal/temporal/service/history/queues/executable.go:347\ngo.temporal.io/server/common/tasks.(*FIFOScheduler[...]).executeTask.func1\n\t/home/runner/work/temporal/temporal/common/tasks/fifo_scheduler.go:224\ngo.temporal.io/server/common/backoff.ThrottleRetry.func1\n\t/home/runner/work/temporal/temporal/common/backoff/retry.go:119\ngo.temporal.io/server/common/backoff.ThrottleRetryContext\n\t/home/runner/work/temporal/temporal/common/backoff/retry.go:145\ngo.temporal.io/server/common/backoff.ThrottleRetry\n\t/home/runner/work/temporal/temporal/common/backoff/retry.go:120\ngo.temporal.io/server/common/tasks.(*FIFOScheduler[...]).executeTask\n\t/home/runner/work/temporal/temporal/common/tasks/fifo_scheduler.go:233\ngo.temporal.io/server/common/tasks.(*FIFOScheduler[...]).processTask\n\t/home/runner/work/temporal/temporal/common/tasks/fifo_scheduler.go:211"}

nsarupr commented 2 months ago

Hey team! Please add your planning poker estimate with Zenhub @ayushpahwa @srix