Add AFM cache volume support

[amdabhad]

Add support for AFM cache volume

• AFM modes supported: IW, RO, SW, LU
  • Driver image: quay.io/amdabhad/csi-driver:afmCaching3041
  • quay.io/amdabhad/csi-driver:afmCaching3053 (with review comments + some improvements)
  • quay.io/amdabhad/csi-driver:afmCaching3065 (With fix for secret mask - scale-core#7094)
  • quay.io/amdabhad/csi-driver:afmCaching3080 (With more review comments + 70% soft quota support by Badri)
  • Operator image: quay.io/amdabhad/csi-operator:afmCaching3002

Signed-off-by: amdabhad amdabhad@in.ibm.com Co-authored-by: jacohn16 jeremy.cohn@ibm.com

Please check the type of change your PR introduces:

• [ ] Bugfix
• [x] Feature Enhancement
• [ ] Test Automation
• [ ] Code Refactoring (no functional changes, no api changes)
• [ ] Build related changes
• [ ] Community Operator listing
• [ ] Other (please describe):

How risky is this change?

• [ ] Small, isolated change
• [ ] Medium, requires regression testing
• [x] Large, requires functional and regression testing

[amdabhad]

@deeghuge, @Jainbrt there should be a better review process in CSI, dev should not spend time on fixing review comments every day.

[amdabhad]

@Jainbrt, you are added as a reviewer 2 weeks back, why are you adding comments immediately after dev approval? Please open defect if you disagree.

[deeghuge]

@Jainbrt, you are added as a reviewer 2 weeks back, why are you adding comments immediately after dev approval? Please open defect if you disagree.

@amdabhad these are valid comment. lets address those as an issue.

[amdabhad]

@Jainbrt, unless it's a blocker issue, we will not change anything in this PR now. Please record your findings in the issues, we will address which are valid ones, thanks!

[Pratibhajoshi]

@deeghuge @hemalathagajendran - Test team covered testing of this PR and is completed with no blockers at this moment.Good to go for merge. Thanks!