iterative / dvc

🦉 ML Experiments and Data Management with Git
https://dvc.org
Apache License 2.0
13.55k stars 1.17k forks source link

exp: refactor workspace execution into an executor #6847

Open pmrowla opened 2 years ago

pmrowla commented 2 years ago

Somewhat adjacent to https://github.com/iterative/dvc/issues/6440 (but not a direct requirement)

Currently workspace execution for experiments is handled directly in repo.experiments, while temp dir (and eventually ssh) execution are handled through the experiments.executor classes. While the executor classes are being reorganized to account for ssh/remote executors, it makes sense for us to refactor the workspace execution handling so that it is in line with the rest of the API.

pmrowla commented 2 years ago

This is something I'll probably get to once the basic remote execution scenarios are taken care of.