MsDataset.load报错

[tianqiong123]

我执行下列代码加载数据集： from modelscope.msdatasets import MsDataset

Loading dataset

hf_ds = MsDataset.load( 'ICASSP_2021_DNS_Challenge', namespace='modelscope',split='test')

出现以下报错： 2024-07-04 13:20:42,801 - modelscope - INFO - PyTorch version 1.11.0+cu113 Found. 2024-07-04 13:20:42,801 - modelscope - INFO - Loading ast index from /home/tian/.cache/modelscope/ast_indexer 2024-07-04 13:20:42,891 - modelscope - INFO - Loading done! Current index file version is 1.15.0, with md5 842522ac9e7126c035b0b056d88b631b and a total number of 980 components indexed transformer is not installed, please install it if you want to use related modules /home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/datasets/load.py:2524: FutureWarning: 'ignore_verifications' was deprecated in favor of 'verification_mode' in version 2.9.1 and will be removed in 3.0.0. You can remove this warning by passing 'verification_mode=no_checks' instead. warnings.warn( /home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/datasets/load.py:926: FutureWarning: The repository for audiolib contains custom code which must be executed to correctly load the dataset. You can inspect the repository content at /home/tian/.cache/modelscope/hub/datasets/modelscope/ICASSP_2021_DNS_Challenge/master/meta/audiolib.py You can avoid this message in future by passing the argument trust_remote_code=True. Passing trust_remote_code=True will be mandatory to load this dataset from the next major release of datasets. warnings.warn( Traceback (most recent call last): File "train.py", line 9, in hf_ds = MsDataset.load( File "/home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/modelscope/msdatasets/ms_dataset.py", line 316, in load dataset_inst = remote_dataloader_manager.load_dataset( File "/home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/modelscope/msdatasets/data_loader/data_loader_manager.py", line 132, in load_dataset oss_downloader.process() File "/home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/modelscope/msdatasets/data_loader/data_loader.py", line 83, in process self._prepare_and_download() File "/home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/modelscope/msdatasets/data_loader/data_loader.py", line 135, in _prepare_and_download self.dataset = hf_load_dataset( File "/home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/datasets/load.py", line 2556, in load_dataset builder_instance = load_dataset_builder( File "/home/tian/miniconda3/envs/frcrn/lib/python3.8/site-packages/datasets/load.py", line 2265, in load_dataset_builder builder_instance: DatasetBuilder = builder_cls( TypeError: 'NoneType' object is not callable

Your Environments (required)

• OS:
• Linux LAPTOP-L8O6SGOA 5.15.153.1-microsoft-standard-WSL2 #1 SMP Fri Mar 29 23:14:13 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
• CPU:
• Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 32 On-line CPU(s) list: 0-31 Thread(s) per core: 2 Core(s) per socket: 16 Socket(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 183 Model name: 13th Gen Intel(R) Core(TM) i9-13900HX Stepping: 1 CPU MHz: 2419.200 BogoMIPS: 4838.40 Virtualization: VT-x Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 48K L1i cache: 32K L2 cache: 2048K L3 cache: 36864K Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology tsc_reliable nonstop_tsc cpuid pni pclmulqdq vmx ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ssbd ibrs ibpb stibp ibrs_enhanced tpr_shadow vnmi ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves avx_vnni umip waitpkg gfni vaes vpclmulqdq rdpid movdiri movdir64b fsrm md_clear serialize flush_l1d arch_capabilities
• 下载pytorch：pip install torch==1.11.0+cu113 torchvision==0.12.0+cu113 torchaudio==0.11.0+cu113 --extra-index-url https://download.pytorch.org/whl/cu113

• python版本：3.8

  @wangxingjun778

[slin000111]

这里看起来是网络的原因

[github-actions[bot]]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.

[github-actions[bot]]

This issue was closed because it has been stalled for 5 days with no activity.