search

ImagingDataCommons / IDC-WebApp

Web Application front end for IDC (CORE REPO)
Apache License 2.0
6 stars 2 forks source link

update download instructions to use idc-index #1399

Closed fedorov closed 3 months ago

fedorov commented 4 months ago

@s-paquette can you also please update the manifest generation part to have the following for the header:

# To download the files in this manifest, first install idc-index python 
# package (https://github.com/ImagingDataCommons/idc-index),
# then run the following command:
#
#   idc download manifest.s5cmd
#
# See IDC documentation for more details: https://learn.canceridc.dev/data/downloading-data
#
fedorov commented 4 months ago

Right now, as discovered by @bcli4d, the revised instructions will not allow download of items from the previous data versions of IDC, that are not available in the current version, which is a regression relative to the pure s5cmd-based approach. It is probably better to wait for the resolution of https://github.com/ImagingDataCommons/idc-index/issues/100 before this is merged.