Implement test cases for the script `github_repo_request_local.py`

[tnzmnjm]

1. Implement Pytest Testing for get_base_repo_urlfunction in github_repo_request_local.py to able to test the desired behaviours with a variety of pseudo URLs.

2. Writing test cases for if "repourl" in df.columns: incomplete_urls = df[ df["repourl"].apply(lambda x: len(x.rstrip("/").split("/")) < 5) ]

3. writing test cases for for url in incomplete_urls["repourl"]: logger.info(f"Excluding the repourl : {url}") df = df[df["repourl"].apply(lambda x: len(x.rstrip("/").split("/")) >= 5)]

[tnzmnjm]

• Add test cases for get_base_repo_url function in the filetests/test_github_repo_request_local.py
• realised my code does not handle the repourls ending with .git correctly, changed the function to address this
• Tests will assert the result of:
  1. Typical GitHub repository URLs with and without '.git' suffix.
  2. URLs pointing to issues and other non-repository pages to test correct base URL extraction.
  3. URLs from other code hosting platforms to ensure versatility.
  4. Edge cases including invalid URLs and URLs with query parameters or fragments.
  5. Empty and None input scenarios to validate function robustness.
• Add tests/__init__.py to the tests directory
• Pushed the code to the branch

[tnzmnjm]

• defined the function filter_incomplete_urls in the script src/github_repo_request_local.py to be able to write test cases efficiently
• adde a helper function inside the filter_incomplete_urls function to handle None values of the repourl
• learnt and wrote these test using Parameterisation Decorator : @pytest.mark.parametrize to define multiple sets of arguments (data, expected_length, expected_urls) for the test function test_filter_incomplete_urls.

[tnzmnjm]

• changed the function filter_incomplete_urls to check if the input url is any type other than string (includes None)

• wrote a new parametrised test block (@pytest.mark.parametrize("data, expected_length") for testing different data types, all entries being non-string types, mixed valid URLs and non-string types

  • Added parameterised tests for URL validation with special characters testing for URLs containing unencoded special characters such as single quotes, angle brackets, spaces, and double quotes, to verify that they are correctly identified as invalid.