Aggregation tasks should use symlinks instead of copies

geoffxy / conductor

🎶 A simple and elegant research computing orchestrator.

GNU Affero General Public License v3.0

4 stars 0 forks source link

Aggregation tasks should use symlinks instead of copies #105

Open geoffxy opened 4 months ago

geoffxy commented 4 months ago

Tasks like combine will copy the experiment results into a new directory. If the results are large, this introduces an unnecessary duplicate. We can achieve something similar by just using a symlink instead.