numaproj / numaplane

Control Plane for Numaproj
Apache License 2.0
13 stars 2 forks source link

Perform FMEA testing for PPND=true #165

Open juliev0 opened 3 months ago

juliev0 commented 3 months ago

Summary

Perform FMEA testing for the data loss prevention flag turned on

Use Cases

When would you use this?


Message from the maintainers:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.

juliev0 commented 3 months ago

Other issue for dataLossPrevention=false here

juliev0 commented 3 months ago

started a spreadsheet of things to test here

juliev0 commented 2 months ago

I am pausing on this task because I will need to add in new logic as part of the Decision Engine work, so I think it makes sense to do this afterward.

I have executed some of the tests in the list and added some results. The testing has exposed some problems which have resulted in other Issues being created.

I have also updated the spreadsheet to describe which items are unlikely to happen using Paved Path at Intuit, which should be considered lower priority.

juliev0 commented 3 weeks ago

I went through the list just now, and I think anything that's on there is not likely given that users will deploy with Paved Path, so many of the uses I mentioned in there won't be possible. And even when users are allowed to make updates that are not explicit settings in the UI (i.e. "Injected changes"), those are still compiled against the pipeline/isbsvc/monovertex Specs.

Therefore, I am pushing this out.