search

HumanBrainProject / ebrains-storage

Python client interface for EBRAINS Collaboratory Drive (Seafile) and Bucket (data-proxy) storage
Apache License 2.0
8 stars 3 forks source link

How do I verify my file integrity for my downloaded zip file? #30

Closed BioCoderR closed 1 month ago

BioCoderR commented 6 months ago

I have requested the access for the controlled access the dataset "brain atlas" and downloaded it using the below command curl --compressed --user biocoderr:************** -H "Authorization: Bearer eyJhbGciOiJSUzI1NiIsInR5cCIgOiAiSldUIiwia2lkIiA6ICJfNkZVSHFaSDNIRmVhS0pEZDhXcUx6LWFlZ3kzYXFodVNJZ1RXaTA1U2k0In0.eyJleHAiOjE3MTI2NjE2NDUsImlhdCI6MTcxMjM2NDEwNCwiYXV0aF90aW1lIjoxNzEyMDU2ODQ1LCJqdGkiOiIwZmJiZGUxYi1mZWYxLTRhNzktYmQ2Ni01ZDI3NGZmYzYxOTciLCJpc3MiOiJodHRwczovL2lhbS5lYnJhaW5zLmV1L2F1dGgvcmVhbG1zL2hicCIsImF1ZCI6InRlYW0iLCJzdWIiOiJlYjc0NTc0Mi1iMjczLTQzZmItOTUzYS1iNzhhYTg4YWE1MDQiLCJ0eXAiOiJCZWFyZXIiLCJhenAiOiJkYXRhLXByb3h5LWZyb250Iiwibm9uY2UiOiJhMDU0ZDkxYy1iNzQ0LTQ4OWEtYWI4Ni1lYmYxYjNmNWE2YjAiLCJzZXNzaW9uX3N0YXRlIjoiYWFjMTgyZmEtNjdhZS00NjI4LWJiMjctMjcwNTg2YmRlOWM0IiwiYWxsb3dlZC1vcmlnaW5zIjpbImh0dHBzOi8vZGF0YS1wcm94eS5lYnJhaW5zLmV1IiwiaHR0cHM6Ly9kYXRhLXByb3h5LXBwZC5lYnJhaW5zLmV1Il0sInNjb3BlIjoicHJvZmlsZSByb2xlcyBlbWFpbCBvcGVuaWQgdGVhbSIsInNpZCI6ImFhYzE4MmZhLTY3YWUtNDYyOC1iYjI3LTI3MDU4NmJkZTljNCIsImVtYWlsX3ZlcmlmaWVkIjp0cnVlLCJuYW1lIjoiUHJhbmF2IFN3YXJvb3AgR3VuZGxhIiwibWl0cmVpZC1zdWIiOiIxMTQ0OTQwMzg0NzU2MjI0IiwicHJlZmVycmVkX3VzZXJuYW1lIjoiYmlvY29kZXJyIiwiZ2l2ZW5fbmFtZSI6IlByYW5hdiBTd2Fyb29wIiwibG9jYWxlIjoiZW4iLCJmYW1pbHlfbmFtZSI6Ikd1bmRsYSIsImVtYWlsIjoicHJhbmF2c3dhcm9vcC5ndW5kbGFAdWstZXNzZW4uZGUifQ.6Xt2aXEvYkNzeRfHJx8E9RFA4HFAx75uYupCwQtHf1vy5tzP1IaZ-PIBbFDaWmzUDf6PacJmUHK2Wh_sQ44tHx8Jy6t64iMN8IVA2CHWuxh0UTGwNnjOrc5CoaogfMx-w1eYEYAH2nMGsSSmuj0isbexlpUZYsndq_LvBqa_x6h0u9zQaPfAE5hsOop7z8sOHUQ3nS3dHixqw3iRxwmZa_N7Qz6w4VwxcbYAMpN9Te8nUoDSSwIiDbAH40wMiIIp9C25fS4g-YhvYG2itwn0BDauSZqrZ90wMxDOujL3dgSGSoIUAV6gR5e1_2B6zw3n0kd009YmfIsqiZOsPtELdQ" "https://data.kg.ebrains.eu/zip?container=https%3A%2F%2Fdata-proxy.ebrains.eu%2Fapi%2Fv1%2Fdatasets%2F8fc108ab-e2b4-406f-8999-60269dc1f994" --output $PWD/brainatlas_v1.zip

How can i verify the checksum or md5sum of this zip file which i downloaded?

Can anyone help me with this issue?!

BioCoderR commented 1 month ago

When you list files in a dataset via the data proxy API endpoint /v1/datasets/{dataset_id}, you can ask for a response in JSON. This will include metadata on each file, including a field named hash, which will give you the MD5 hash (a.k.a. checksum) for the given file. Once you have downloaded the files, you can calculate the same hash on your local system and compare the two. Remember to include "accept": "application/json" in the header of your request in order to get the file list as json.