search

empiricalci / emp

:microscope: Empirical CLI
https://empiricalci.com
MIT License
42 stars 7 forks source link

Only mount to the container the data files specified in the dataset #63

Closed alantrrs closed 8 years ago

alantrrs commented 8 years ago

Currently the whole data directory is being mounted to /data on the experiment container. The user then needs to refer to the files using its hash which is not very user friendly. We could instead mount the files individually and refer to them by the key name.

For example a data file with the following config:

"myfile.csv": {
  "url": "http://example.com/myfilesdsds.csv",
  "hash": "sdfd39asaea334353fdfh4sfsd3432353"
}

would be mounted from the host path /home/empirical/data/sdfd39asaea334353fdfh4sfsd3432353 to the container path /data/myfile.csv