Large Index Zenodo Remote Migration

[codecov[bot]]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 97.05%. Comparing base (ba0a902) to head (0bb58c1). Report is 1 commits behind head on master.

Additional details and impacted files

```diff @@ Coverage Diff @@ ## master #632 +/- ## ========================================== - Coverage 97.13% 97.05% -0.08% ========================================== Files 66 66 Lines 7493 7503 +10 ========================================== + Hits 7278 7282 +4 - Misses 215 221 +6 ```

[guillemcortes]

Hi @tanmayy24 ! We've been checking the PR with @genisplaja and we believe that we should replicate the changes done in Soundata (PR: https://github.com/soundata/soundata/pull/169/) this includes the following pending changes (even though there might be other that we missed):

• [x] Modify get_index() as in soundata (basically remote indexes are stored in the same folder as now)
• [x] Edit the _index() as done in soundata:
• [x] We actually updated the whole Index class, which accommodates the remote index strategy by default :)
• [x] download_utils() → Check and mimic diff file in soundata PR
• [x] Mirdata init → list_dataset_versions
• [x] Check changes introduced in test_download_utils(), test_core() , test_loaders() and mimic them
• [ ] Move sample indexes to tests folder as in soundata (Will be addressed in #641 )

[guillemcortes]

EDIT: I wrote this before actually reviewing the PR. I detailed all necessary changes in furhter comments so this one can be ignored (even though I think it is still a good idea to check that PR)

It would be great to double check with what we did in Soundata to make sure we are not missing anything. Here's the TODO list of that PR. I think that we are missing all the changes in the documentation, for instance. https://github.com/soundata/soundata/pull/169#issuecomment-2107207637