Automated Testing for OCM CLI

[robertwol]

User Story:

As a developer or contributor to the OCM project, I want to have automated testing in place to ensure the reliability and functionality of the OCM CLI and related components. This will help identify and fix issues early, improve code quality, and provide a robust user experience.

Epic link:

• open-component-model/ocm-project#125

List of Potential Tasks

1. Create end-to-end (E2E) tests for OCM commands and their common variants to cover different use cases.
2. Develop a simple OCM GitHub action that verifies the basic functionality of the CLI without requiring sources, resources, or components.yaml.
3. Implement test scenarios and scripts to cover 80% of the common use cases of OCM.
4. Set up a testing framework (e.g., using a testing library or framework) for automated testing of OCM.
5. Create test data and fixtures to simulate various scenarios and edge cases.
6. Write unit tests for critical functions, modules, or libraries used in the OCM project.
7. Integrate the automated tests into the project's continuous integration (CI) pipeline.
8. Define a code coverage threshold and ensure that the tests meet or exceed the defined coverage percentage.
9. Establish a process for regularly updating and maintaining the automated tests as new features and changes are introduced.

Definition of Done

• [ ] E2E tests cover a comprehensive range of OCM commands and their common variants.
• [ ] The simple OCM GitHub action is implemented and verifies the basic functionality of the CLI.
• [ ] Test scenarios and scripts cover 80% of the common use cases of OCM.
• [ ] A testing framework is set up and integrated into the CI pipeline.
• [ ] Unit tests are written for critical functions, modules, or libraries.
• [ ] Test data and fixtures are created to simulate various scenarios and edge cases.
• [ ] The automated tests meet or exceed the defined code coverage threshold.
• [ ] A process is established to update and maintain the automated tests regularly.

Related issues:

• open-component-model/ocm-project#118 (just mention the number of the related issue here, it will appear as clickable link later)
• open-component-model/ocm-project#117 (just mention the number of the related issue here, it will appear as clickable link later)

[Skarlso]

What remains to be done here? The integration test thingy is running and working, isn't it?