common automatic update

[mbaldessari]

• Added callbacks to ansible.cfg
• Updated ansible.cfg with non-deprecated feature.
• Upgrade ESO to 0.6.1
• Make sure we can parse FQDNs after a secrets tag in values-secrets.yaml
• Reorganize tests in preparation for a V2 secrets format
• Add ansible unittest
• Use proper 3.9 version that exists in ubuntu
• Install pytest via pip
• Add ansible in the pip modules
• Add support for creating temporary files and referncing them in tests
• Revert to a simpler way to test file upload
• Add tearDown() in unit tests
• Add ansible/tests/unit/v1/values-secret-good.yaml
• Fix super linter warnings
• Add support for /values--.yaml
• Fix gitleaks file after last unit test change
• Allow multiple test inputs
• Initial v2 plumbing
• Add module_utils path for shared common code
• Move v1 secret functions in module_utils
• Split out common function in separate file
• Move the secret format implementation in classes
• A bunch of cleanups of unit-testing. Still not fully passing
• Have super-linter pass
• Fix patching the right function
• Start unit testing V2 as well
• Add version check in v1 implementation
• Force get_version() to return a string for the time being
• Pass proper parameters to V2 class
• Initial start of vault policies implementation
• More validation and more V2 testing
• Make sure we check if the vaultPolicy exists
• Make error message clearer
• Add a lot more tests and start implementing the files: section
• Fix black errors
• Cleanups and also call check_missing_secrets only on v1.0
• Fix black errors
• Add a test to cover for empty vaultPrefixes
• Add support and tests for the password generation via policy
• Actually use the proper oc exec call to generate secrets
• Implement file uploading as base64 attribute as well
• Move more logic into _get_file_path
• Large rewrite to unify fields and files and add initial base64 support and tests
• Add base64 support for secrets as well and fix up tests
• POC mostly working at this point
• For the time being always stay on getpass.getpass() for input
• Remove unused modules
• Add checks for duplicate secret names and field names
• Switch to using AnsibleModule.run_command
• Make the secret prompting a little prettier
• Implement looking for ~/values-secret-.yaml first
• Test base64 secret
• Silence yaml indentation linting errors and more
• Added values-secret examples
• Drop callbacks_enabled
• Add another relevant change in Changes.md
• Error out nicely if yaml.safe_load() cannot parse the file
• Add support for ansible-vault
• Clean up comments in test-cases files and implement backingStore
• Use sensible prompt strings
• Be clearer in the text about ansible-vault
• Move checks that are specific to the version inside classes
• Add a test for erroring out when values_secret_template is not defined and check_missing_secrets is set to true
• Add a default validatedPatternDefaultPolicy password policy
• Forgot to add new test for default vp-policy
• Make sure we re-attempt all vault commands in case of failure
• Add some more documentation
• Add initial v2 schema json file
• Rename the description field to prompt as that is what it is really used for
• value and path can be 'null' when onMissingValue is set to 'prompt'
• Make version a string all the time
• Require some more fields
• Add some more examples to the schema file
• Test json schema CI job
• Fix small ansible lint warning
• Also try {{ pattern_dir }}/values-secret.yaml.template if all others failed
• Fix Changes.md with a small nit
• Prompt ansible-vault password via ansible.builtin.pause
• Make the tasks text less intimidating
• Add json schema for the v1 secret format
• Allow picking a custom values-secret.yaml file via the VALUES_SECRET env var
• Add filter_plugins path in common
• Add override attribute support
• Move to draft-07 of the json schema for V2
• Do not raise exception if secret's existence check fails
• Upgrade vault-helm to v0.23.0
• Filter out patches to test/
• Add patch to be able to use vault-ssl as a default
• Switch to vault-ssl as a default
• Remove stable default from channels
• Split secret counter in two variables
• Validation Schema for common/clustergroup
• • Fixed issues with schema validation in values.schema.json - Modified clustergroup/values.yaml and examples/values-example.yaml to have same sections and values. - Updated tests for tests/clustergroup-naked.expected.yaml and tests/clustergroup-normal.expected.yaml
• Fixed issues with kubeconform in clustergroup/values.yaml. Reran make test to generate proper files
• • Updated schema to include all elements in subscriptions - Updated tests associated with clustergroup - Updated values-example.yaml
• applications and subscriptions can be obj and array
• restore values.yaml file to a saner commented default
• Ran values.schema.json through jq to fix indentation issues
• Fix up tests
• Move to draft 0.7 of the schema spec
• Add operatorgroupExcludes which is in examples/industrial-edge-factory.yaml
• namespace is not mandatory in an application
• Fix up some more tests
• add clusterSelector in managedClusterGroups
• Allow clusterRoleYaml to be an array and timeout to be a string
• Add image, tags, extravars to imperative job object
• Add descriptions for SecretStore properties
• move GlobalGit and GitSecret after Main
• Forgot ,
• Move testing targets after the installation ones
• Move some of the oc calls into the legacy target
• Simplify getting the remote git URL associated to the target origin
• Drop legacy-install from common
• Move comments in the right place
• Clean up PHONY targets in Makefile
• Move all testing-related variables closer to the tests target
• Make sure we error out after the legacy removal
• Fix up the main section a bit
• Make subscriptions not mandatory
• Add description to main.git fields
• Drop useCSV from global
• Add description for main.gitops.channel
• Add some descriptions
• Mark useCSV as deprecated
• • Added descriptions for namespaces, subscriptions, managedClusterGroup, applications, and projects
• • Fixed issue with description definition
• drop insecureUnsealVaultInsideCluster entirely
• • Removed insecure boolean from schema file and from values-example.yaml
• Re-ran make tests
• Drop any remains of output_file
• Updated python-version for json schema
• Update python version for ansible-unittest
• Add filter to parse ACM secrets
• Update ESO to 0.7.0
• Only set vaultkeys fact when the vault is sealed
• Default vaultPrefixes to be ["hub"]
• Fix two V2 secret format corner-case bugs
• Add SkipDryRunOnMissingResource=true on ClusterPools, ClusterClaims and ManagedClusterSets
• Add mention of VALUES_SECRET env variable
• Add a get_ini_value() commodity function
• Fix up ini function and add tests
• Add ini_file support
• Relax json schema and drop onMissingValue as required
• Fix up json schema errors
• Fix base64 file upload
• Fix schema json when using HostedArgo
• Simplify hosted argo secret paths
• Add "vault_path" to the parse_acm_secrets filter
• Fix up some pylint warnings
• Set additionalProperties to true for top-level objects
• Fix some validation schema warnings
• Introduce a validate-schema Makefile target
• Do not run validate-schema by default
• helmOverride.value can be both a string and a boolean
• Make sure our readOnly attributes are proper booleans
• Drop managedClusterGroups as a required property
• Drop 'pattern' as a required property
• Run check-json schema for all yaml files under examples/
• Allow subscriptions to be null
• Add prereq check to the operator-deploy
• Vault delete task is unused, remove it
• Drop pki init as it is unused
• Drop push_secrets.yaml playbook as it is unused
• Make sure we error out with a proper message if python-kubernetes is missing
• Make prerequisited output checking more consistent
• Prettify the output for checking prerequisites
• Extend framework to allow for ESO on ACM-imported clusters
• Add a global policy in the vault configuration
• Make sure we use specialized vars for spokes
• Switch to quay.io/hybridcloudpatterns/utility-container
• Upgrade ansible-lint action
• Address a bunch of ansible-lint warnings
• Upgrade ESO to v0.7.2
• Add acm policy to push HUB's CA to managed clusters
• Point golang-external-secrets to the secret injected by ACM
• Drop imperative job to fetch ACM HUB CA as we use ACM to push that out to clusters
• Fix up tests
• Loosen grep regex to catch compound/alias Makefile targets
• Add pattern-home mount to allow resolution of ~ in files
• Better help output
• Stop outputting help for deprecated commands
• Drop old unused vault-init and insecureUnsealVaultInsideCluster
• Drop legacy-install and move to new help system
• Drop unused common-test
• Switch to new test target
• Allow additional properties for GlobalGit
• Switch to new tests

[claudiol]

@ipbabble and @day0hero We have made a lot of changes to common which we feel this pattern will benefit from. If you could please update your common and test against the DevSecOps pattern to make sure that it doesn't break anything.

Also, the global git section has changed and it uses the account property for username and account. So if you could update your values-global.yaml accordingly that would be great.

git: hostname: github.com account: PLAINTEXT

username: PLAINTEXT <=== Not part of the schema for git section.

email: SOMEWHERE@EXAMPLE.COM
dev_revision: main

Let us know how we can assist.