I was wondering if its possible to speedup the first time download/ load of RIT catalog using parallel requests. As I understand, the catalog presently downloads the metadata serially. It takes about half a day to download the catalog.
Would it be possible to cut down this time using wget's parallel download (using a constructed list of urls) or multiple processes?
I was wondering if its possible to speedup the first time download/ load of RIT catalog using parallel requests. As I understand, the catalog presently downloads the metadata serially. It takes about half a day to download the catalog.
Would it be possible to cut down this time using wget's parallel download (using a constructed list of urls) or multiple processes?