search

disarm-platform / fn-covariate-extractor

OpenFaas version of the covariate extractor
MIT License
1 stars 0 forks source link

can we stop the downloaded files being dumped in with the source files? #5

Open onlyjsmith opened 5 years ago

onlyjsmith commented 5 years ago

We could create a 'tmp' folder in the top level.

Currently the top level of the repo starts as

├── Dockerfile
├── fn-covariate-extractor.Rproj
├── function.R
├── test.R
├── utils.R

but after the first run it looks like

├── Dockerfile
├── TZA_msk_alt.grd
├── TZA_msk_alt.gri
├── TZA_msk_alt.vrt
├── fn-covariate-extractor.Rproj
├── function.R
├── test.R
├── utils.R
├── waterTZA
│   ├── TZA_water_areas_dcw.dbf
│   ├── TZA_water_areas_dcw.prj
│   ├── TZA_water_areas_dcw.shp
│   ├── TZA_water_areas_dcw.shx
│   ├── TZA_water_lines_dcw.dbf
│   ├── TZA_water_lines_dcw.prj
│   ├── TZA_water_lines_dcw.shp
│   └── TZA_water_lines_dcw.shx
├── waterTZA.zip
└── wc10
    ├── bio1.bil
    ├── bio1.hdr
    ├── bio10.bil
    ├── bio10.hdr
    ├── bio11.bil
    ├── bio11.hdr
    ├── bio12.bil
    ├── bio12.hdr
    ├── bio13.bil
    ├── bio13.hdr
    ├── bio14.bil
    ├── bio14.hdr
    ├── bio15.bil
    ├── bio15.hdr
    ├── bio16.bil
    ├── bio16.hdr
    ├── ...
HughSt commented 5 years ago

We could dump the files in a 'data' folder?

onlyjsmith commented 4 years ago

We're now caching the files, but this is likely still happening If we're scaling the containers to zero, is likely this will only be temporary (i.e. as long as container is alive), so maybe fine to leave, but to note as not the ideal behaviour? If we want to fix, agree with @HughSt suggestion to just use a local data folder.

onlyjsmith commented 4 years ago

Moved to icebox for now