Feature/multi loader

[nosnelmil]

Summary

A wrapper around loader to run multiple studies at once with additional features like validation, dry-run and log collection

Implementation Notes :hammer_and_pick:

• Multi-Loader Entry Point:

  • MultiLoaderRunner houses the main logic of the multi-loader and exposes two execution points: RunDryRun and RunActual
  • multi_loader.go in tools/multiloader/ initializes the MultiLoaderRunner and calls the appropriate execution point

• Experiment Execution Flow:

  • The multi-loader runner is instantiated with the provided configuration path
  • Execution is split into three phases: pre-execution, execution, and post-execution
  • Pre-Execution: Executes global pre-scripts, sets up directories, and unpacks sub-experiments.
  • Execution: Runs experiments with the generated configurations and appropriate flags and collect loader.go logs.
  • Post-Execution: Executes experiment-specific post-scripts and performs necessary cleanup tasks.
  • If the execution is a dry run, the same flow is followed, but the dryRun flag is set to true when calling loader.go

• Post Execution:

  • Global post-scripts are executed after the experiments finish
  • Executes Make Clean
  • Temporary folders are removed

External Dependencies :four_leaf_clover:

• N/A

Breaking API Changes :warning:

• N/A

Simply specify none (N/A) if not applicable.