indeedeng / iwf

iWF is a WorkflowAsCode microservice orchestration platform offering an orchestration coding framework and service for building resilient, fault-tolerant, scalable long-running processes
MIT License
537 stars 55 forks source link

Ignore empty values for output collectors #386

Open longquanzheng opened 6 months ago

longquanzheng commented 6 months ago

So that continues as new is more efficient at storage cost.

In the cast of many gracefulComplete or deadEnd threads, the output collectors will store lots of empty state output like below.

Screenshot 2024-09-24 at 2 27 45 PM

We could ignore the state completion output that have empty results