Added the ability to execute tasks in parallel using the child_process module, leveraging os.availableParallelism() to determine the number of available CPU cores.
This was applied to the runParallelAssignRoles and runParallelEmailPreRender functions, allowing multiple processes to run simultaneously, thus optimizing task execution time.
Dockerfile Modifications:
The Dockerfile was updated to include the necessary Python dependencies for the match_roles feature. The following changes were implemented:
Creation of a Python virtual environment (venv) within the match_roles directory.
Execution of the generateDataMatchRoles script to fetch the required roles and skills for match_roles to function correctly.
Installation of Python dependencies listed in requirements.txt.
Execution of the onehot.py script to ensure that data is properly prepared.
Parallelism with child_process:
Added the ability to execute tasks in parallel using the child_process module, leveraging os.availableParallelism() to determine the number of available CPU cores.
This was applied to the runParallelAssignRoles and runParallelEmailPreRender functions, allowing multiple processes to run simultaneously, thus optimizing task execution time.
Dockerfile Modifications:
The Dockerfile was updated to include the necessary Python dependencies for the match_roles feature. The following changes were implemented:
Creation of a Python virtual environment (venv) within the match_roles directory.
Execution of the generateDataMatchRoles script to fetch the required roles and skills for match_roles to function correctly.
Installation of Python dependencies listed in requirements.txt.
Execution of the onehot.py script to ensure that data is properly prepared.