Odin-SMR / odin-api

MIT License
0 stars 0 forks source link

Read external data from s3-buckets #153

Closed joakimmoller closed 1 year ago

joakimmoller commented 1 year ago

Odin-api relies on several local disk directories:

Some of them will be on a S3-bucket -> need updated access functions. Some of them will simply be copied to a volume attached to the EC2.

    - /odindata/extdata/ERA-Interim:/var/lib/odindata/ECMWF:rw
    - /odindata/extdata/ERA-Interim:/ecmwf-data:rw
    - /odindata/vds-data:/vds-data:ro
    - /db/zpt:/var/lib/odindata/ZPT:rw
    - /db:/var/lib/odindata:rw
    - /nido/osiris/Level2/Daily:/osiris-data:ro
    - /nido/smr/Data/SMRl2/SMRhdf/Qsmr-2-1:/odin-smr-2-1-data:ro
    - /nido/smr/Data/SMRl2/SMRhdf/Qsmr-2-0:/odin-smr-2-0-data:ro
    - /nido/smr/Data/SMRl2/SMRhdf/Qsmr-2-3:/odin-smr-2-3-data:ro
    - /nido/smr/Data/SMRl2/SMRhdf/Qsmr-2-4:/odin-smr-2-4-data:ro
    - /home/odinop/.cdsapirc:/root/.cdsapirc:ro
    - /db_sdb1/odin/l2netcdf:/data/odin-l2-data:rw
    - /db_sdb1/odin/MesosphEO:/data/MesosphEO:rw
joakimmoller commented 1 year ago

Find a npm package that can serve object from buckets, install that in the bucket, make it publicly available. Point odin-site to that resource.

skymandr commented 1 year ago

Isn't this all done, @joakimmoller ?

joakimmoller commented 1 year ago

done.