tnzmnjm
commented
3 weeks ago Add src/DS/metrics_extraction.py script
- Introduced a
read_and_parse_fileutility function for handling file reading and AST parsing, reducing code duplication and improving error handling. - Enhanced logging across the script:
- Added detailed logging for each step in the file analysis process, including DEBUG, INFO, WARNING, and ERROR levels.
- The script loads an existing DataFrame if available, allowing it to continue from where it left off.
- Improved the use of dictionary unpacking (
**) for merging analysis results into the final DataFrame, ensuring clean and maintainable code. - Refactored the script to introduce batch processing for saving results, reducing the frequency of I/O operations and improving overall performance. Results are now accumulated in memory and written to the output CSV file in batches (default: 100 files per batch).
- Added
argparsefor command-line argument parsing, allowing users to specify input and output file paths.
This is related to the issue #84
Through detailed examination of the testing methodologies, tools, and frameworks employed across these repositories, this branch will work towards understanding common patterns and identifying areas for improvement or standardisation. The insights gained will potentially lead to the development of strategies that can be applied across various projects, enhancing their testing processes and overall software quality.