Simplified and optimized print statements for better readability.
Documentation Enhancements
Added and linked Jupyter Notebooks in documentation.
Improved table of contents (ToC) structure for better navigation.
Removed unnecessary files and updated file paths.
Jupyter Notebook Integration
Multiple attempts to include and correctly link Jupyter Notebooks in the documentation.
Finalized direct linking of .ipynb files and updated ToC levels accordingly.
Code Refinements
Added methods: get_data_products_expected(), styled_text(), and check_all_QC_keywords_present().
Moved keyword management to CSV files for easier handling.
Refactored method names for consistency and readability.
Added warnings for Docker-specific executions.
Database and Query Enhancements
Consolidated database code and introduced pandas-based queries.
Handled cases without database connections gracefully.
Improved database query error handling.
Pipeline and Processing Updates
Introduced auto-throttling with delay parameters for job scheduling.
Adjusted master processing and sorting mechanisms.
Modified QC methods and processing steps for better accuracy and performance.
Commits Breakdown
May 29, 2024:
Streamlined print statements.
Fine-tuned wording.
Linked Jupyter Notebooks and refined include statements.
Updated ToC structure and fixed file paths.
May 30-31, 2024:
Addressed database connection issues.
Merged updates from various branches to keep the documentation preview branch up to date.
June 1-5, 2024:
Added new methods and adjusted QC execution.
Included CSV files for managing keywords.
Implemented auto-throttling and added delays in job scheduling.
June 12-18, 2024:
Enhanced master processing and merged relevant updates.
Consolidated database code and improved query mechanisms.
June 26-July 19, 2024:
Continued database code consolidation and optimization.
Improved QC and pipeline processing steps.
July 20-24, 2024:
Finalized and merged pending updates.
Added master_types dictionary for better master processing management.
Changes Summary Concise Print Statements
Simplified and optimized print statements for better readability. Documentation Enhancements
Added and linked Jupyter Notebooks in documentation. Improved table of contents (ToC) structure for better navigation. Removed unnecessary files and updated file paths. Jupyter Notebook Integration
Multiple attempts to include and correctly link Jupyter Notebooks in the documentation. Finalized direct linking of .ipynb files and updated ToC levels accordingly. Code Refinements
Added methods: get_data_products_expected(), styled_text(), and check_all_QC_keywords_present(). Moved keyword management to CSV files for easier handling. Refactored method names for consistency and readability. Added warnings for Docker-specific executions. Database and Query Enhancements
Consolidated database code and introduced pandas-based queries. Handled cases without database connections gracefully. Improved database query error handling. Pipeline and Processing Updates
Introduced auto-throttling with delay parameters for job scheduling. Adjusted master processing and sorting mechanisms. Modified QC methods and processing steps for better accuracy and performance. Commits Breakdown May 29, 2024:
Streamlined print statements. Fine-tuned wording. Linked Jupyter Notebooks and refined include statements. Updated ToC structure and fixed file paths. May 30-31, 2024:
Addressed database connection issues. Merged updates from various branches to keep the documentation preview branch up to date. June 1-5, 2024:
Added new methods and adjusted QC execution. Included CSV files for managing keywords. Implemented auto-throttling and added delays in job scheduling. June 12-18, 2024:
Enhanced master processing and merged relevant updates. Consolidated database code and improved query mechanisms. June 26-July 19, 2024:
Continued database code consolidation and optimization. Improved QC and pipeline processing steps. July 20-24, 2024:
Finalized and merged pending updates. Added master_types dictionary for better master processing management.