harsha-simhadri / big-ann-benchmarks

Framework for evaluating ANNS algorithms on billion scale datasets.
https://big-ann-benchmarks.com
MIT License
356 stars 118 forks source link

Add --from-to option to azcopy command #295

Closed suri-kumkaran closed 3 months ago

suri-kumkaran commented 5 months ago

Add --from-to option to azcopy command as downloading turing-1b dataset is failing without this option.

harsha-simhadri commented 3 months ago

@suri-kumkaran could you please link to the documentation of this option and why this solves the issue

magdalendobson commented 3 months ago

I was able to reproduce the problem and confirm that @suri-kumkaran's suggestion fixed it for me.

maumueller commented 3 months ago

@suri-kumkaran Thanks for the contribution.

I checked it and your proposal didn't work for the other branch that would invoke axel as download manager. Please verify that my fix works for you.

suri-kumkaran commented 3 months ago

Hey @maumueller , yes this works for me. Thanks for testing the axel branch.