Deploy with new scheduler

[hunhoffe]

What this PR contains:

• Deploy etcd and scheduler components
• Allow option to enable or disable the scheduler (similar to ansible)
• Akka cluster config setup for replicating the scheduler
• Tested with and without scheduler enabled on 3-node Kubernetes cluster with CouchDB activation store

Some changes are needed to the scheduler to support the akka cluster discovery mechanism. The scheduler also needs to be integrated into the build process. These changes are in PR#5278 of apache/openwhisk.

Tasks:

• [x] Merge/finalize PR for apache/openwhisk with Akka cluster management changes for scheduler, controller & updates to scripts that create docker images, etc.
• [x] Update docker image tags once images are generated
• [x] Update documentation

Future Work:

• etcd will currently always start fresh as a deployment specifically for an openwhisk deployment; future work could be to add persistence and also to support external etcd. I added in documentation that persistence to etcd was not currently supported and in a comment that the external etcd was not supported.
• Does not support dedicated invoker feature, e.g., https://github.com/apache/openwhisk/pull/5292

[hunhoffe]

Having issues with inProgressJobRetention parsing in new scheduler image, see: https://github.com/apache/openwhisk/pull/5281

[style95]

@hunhoffe This is great! Thank you for your contribution.

[hunhoffe]

I believe I've addressed all comments except the external etcd feature. I wrote a comment that it is not yet supported in the values.yaml file, and I'm hoping that it is a feature that could be added later; I could create an issue for it so it is not forgotten if that's acceptable.

[style95]

I could create an issue for it so it is not forgotten if that's acceptable.

I am ok with this.

[hunhoffe]

I created an issue for the external etcd support and fixed the timestamp (https://github.com/apache/openwhisk-deploy-kube/issues/751). Pending any further feedback, I believe this is ready for merge. Thank you for your time in reviewing @style95 and @dgrove-oss!