Azure / durabletask

Durable Task Framework allows users to write long running persistent workflows in C# using the async/await capabilities.
Apache License 2.0
1.53k stars 296 forks source link

Activities get retried as their messages no longer exist #1049

Open hectorm-bmg opened 8 months ago

hectorm-bmg commented 8 months ago

Hi,

I have a durable function that uses service bus to check on the progress of a process.

The orchestration basically does the following:

The problem we are seeing is that the CheckStatus activities are getting rescheduled to be run 5 minutes in the future. The message we are seeing look like this:

Failed to update or delete message [TaskScheduled#1] with ID = c4ceddc9-2288-4e78-a1cc-58b230398d7a because it no longer exists

The orchestration is actually able to complete but these zombie activities keep running for a while.

The HangRequest activity that is outside of the loop does not seem to have this issue. It's only the activities ran in the while loop that present this issue.

hectorm-bmg commented 8 months ago

This issue is a show stopper for our use of durable functions. Any suggestions on how to resolve this would be really appreciated. Thanks!!