Added a new argument to the neps.run function to enable the generation of post-run CSV files.
The generated CSV files now include the status of each configuration, along with existing data such as result, metadata, and configuration information. In addition to summarized data about the run in the run_data.csv.
Introduced file locking mechanism inspired by the one used in metahyper to ensure smooth operation with multiple workers.
Implemented checks on the current CSV file and data for scenarios involving multiple workers, ensuring data integrity.
Added a unit test that executes after the metahyper_locking test, validating the functionality introduced in this PR.
Pull Request Summary:
neps.run
function to enable the generation of post-run CSV files.metahyper
to ensure smooth operation with multiple workers.metahyper_locking
test, validating the functionality introduced in this PR.