search

dandi / helpdesk

Repository to track help tickets from users.
3 stars 0 forks source link

dandi download fail on mac os M1 #37

Closed Costas13 closed 2 years ago

Costas13 commented 2 years ago

attempted to download a few different data sets using dandi from BICCN. I consistently get the following message:

% dandi download https://girder.dandiarchive.org/api/v1/item/5f00d711a78c4b52bbb386e9/download 2021-11-05 07:37:14,290 [ WARNING] A newer version (0.31.0) of dandi/dandi-cli is available. You are using 0.6.4 2021-11-05 07:37:14,292 [CRITICAL] You are using a version of dandi/dandi-cli with a critical bug. Please use a different version. Error: HTTPSConnectionPool(host='girder.dandiarchive.org', port=443): Max retries exceeded with url: /api/v1/item/5f00d711a78c4b52bbb386e9 (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7fedd9110518>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known',))

I have tried implementing in different python environments (py36-py38) as well as used a number of different dandi versions (0.6.4-0.17.0). I basically keep receiving the same "critical error". I am running Big Sur on a Mac OS M1.

Any suggestions or ideas how to resolve this? Thank you!

Costas13 commented 2 years ago

update: i also tried running dandi --version 0.31.0 on an Intel Mac running Big Sur with the same result: critical error. Here is an excerpt from the log:

2021-11-05T08:11:18-0700 [DEBUG ] dandi 5581:4462419456 Caught exception HTTPSConnectionPool(host=‘girder.dandiarchive.org’, port=443): Max retries exceeded with url: /api/v1/item/5f00d711a78c4b52bbb386e9/download (Caused by NewConnectionError(‘<urllib3.connection.HTTPSConnection object at 0x7fabf91ae5d0>: Failed to establish a new connection: [Errno 8] nodename nor servname provided, or not known’))

jwodder commented 2 years ago

girder.dandiarchive.org is no longer in use, and has been out of commission for months. As a result, downloading from girder.dandiarchive.org URLs no longer works. You need to use the up-to-date URLs obtained from https://gui.dandiarchive.org (found, e.g., by clicking the "Download" button on a Dandiset page or by copying a download link for an individual file).

Costas13 commented 2 years ago

Thanks for the note jwodder. I actually tried what you suggested (i.e. going on gui.dandiarchive.org and getting the direct link from the "download" button). When i do that i basically get the same critical error:

% dandi download DANDI:000023/0.210914.1900 2021-11-05 08:58:53,165 [ WARNING] A newer version (0.31.0) of dandi/dandi-cli is available. You are using 0.17.0 2021-11-05 08:58:53,167 [CRITICAL] You are using a version of dandi/dandi-cli with a critical bug. Please use a different version. 2021-11-05 08:58:53,683 [ INFO] Logs saved in /Users/anastassioc/Library/Logs/dandi-cli/20211105155852Z-42133.log Error: Response for getting https://identifiers.org/DANDI:000023/0.210914.1900 to redirect returned 400. Please verify that it is a URL related to dandiarchive and supported by dandi client

% dandi --version 0.17.0

Thoughts?

jwodder commented 2 years ago

The website seems to be listing invalid resource identifiers for downloading specific versions; I'll bring that up with the other developers. In the meantime, the correct command (well, one of them) for downloading version 0.210914.1900 of Dandiset 000023 is:

dandi download https://dandiarchive.org/dandiset/000023/0.210914.1900

Also, you really, really should be using the latest version of the dandi client at all times, as there have been various breaking changes to the server's API and other components over the past year, meaning that old versions are likely to be completely inoperable in various ways.

satra commented 2 years ago

@Costas13 - this url (https://identifiers.org/DANDI:000023/0.210914.1900) should be valid in theory, but the identifiers.org developers need to fix a bug. if you make it all lowercase it works right now (https://identifiers.org/dandi:000023/0.210914.1900)

Costas13 commented 2 years ago

It worked, thank you for the help!