ESGF / esgf-wget

Service API endpoint for simplified wget scripts
0 stars 4 forks source link

Simplification / simplified mode #15

Closed sashakames closed 4 years ago

sashakames commented 4 years ago

Could we consider a even simpler template that takes no arguments? No checksum support and might consider no security (skip cert CA verification, too). This was suggested by Phil at a recent meeting.

This might be along side the version that supports checksumming, resume mode, additional options.

Not required for initial release.

mauzey1 commented 4 years ago

I have created a simplified script that only has a list of URLs for files to download. Below is an example.

#!/bin/bash

download_files=(
'http://aims3.llnl.gov/thredds/fileServer/user_pub_work/CMIP6/CMIP/E3SM-Project/E3SM-1-1/piControl/r1i1p1f1/Amon/huss/gr/v20191029/huss_Amon_E3SM-1-1_piControl_r1i1p1f1_gr_185001-187412.nc'
'http://aims3.llnl.gov/thredds/fileServer/user_pub_work/CMIP6/CMIP/E3SM-Project/E3SM-1-1/piControl/r1i1p1f1/Amon/huss/gr/v20191029/huss_Amon_E3SM-1-1_piControl_r1i1p1f1_gr_187501-189912.nc'
'http://aims3.llnl.gov/thredds/fileServer/user_pub_work/CMIP6/CMIP/E3SM-Project/E3SM-1-1/piControl/r1i1p1f1/Amon/huss/gr/v20191029/huss_Amon_E3SM-1-1_piControl_r1i1p1f1_gr_190001-192412.nc'
'http://aims3.llnl.gov/thredds/fileServer/user_pub_work/CMIP6/CMIP/E3SM-Project/E3SM-1-1/piControl/r1i1p1f1/Amon/huss/gr/v20191029/huss_Amon_E3SM-1-1_piControl_r1i1p1f1_gr_192501-194912.nc'
'http://aims3.llnl.gov/thredds/fileServer/user_pub_work/CMIP6/CMIP/E3SM-Project/E3SM-1-1/piControl/r1i1p1f1/Amon/huss/gr/v20191029/huss_Amon_E3SM-1-1_piControl_r1i1p1f1_gr_195001-197412.nc'
'http://aims3.llnl.gov/thredds/fileServer/user_pub_work/CMIP6/CMIP/E3SM-Project/E3SM-1-1/piControl/r1i1p1f1/Amon/huss/gr/v20191029/huss_Amon_E3SM-1-1_piControl_r1i1p1f1_gr_197501-199912.nc'
'http://aims3.llnl.gov/thredds/fileServer/user_pub_work/CMIP6/CMIP/E3SM-Project/E3SM-1-1/piControl/r1i1p1f1/Amon/huss/gr/v20191029/huss_Amon_E3SM-1-1_piControl_r1i1p1f1_gr_200001-201412.nc'
)

for i in "${download_files[@]}"
do
   wget $i
done