执行ceate_data.py 报错

[account15222]

执行该命令CUDA_VISIBLE_DEVICES=0 python create_data.py 报错信息如下

[2024-08-14 09:10:54 INFO   ] trainer:create_data:458 - 开始生成数据列表...
100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 79114/79114 [00:45<00:00, 1724.42it/s]
[2024-08-14 09:11:40 INFO   ] utils:create_manifest:144 - 完成生成数据列表，数据集总长度为206.86小时！
[2024-08-14 09:11:40 INFO   ] trainer:create_data:466 - ======================================================================
[2024-08-14 09:11:40 INFO   ] trainer:create_data:467 - 开始生成噪声数据列表...
[2024-08-14 09:11:40 INFO   ] utils:create_noise:252 - 噪声音频文件为空，已跳过！
[2024-08-14 09:11:40 INFO   ] trainer:create_data:472 - ======================================================================
[2024-08-14 09:11:40 INFO   ] trainer:create_data:474 - 开始生成数据字典...
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 78955/78955 [00:05<00:00, 13761.90it/s]
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 159/159 [00:00<00:00, 14005.09it/s]
[2024-08-14 09:11:46 INFO   ] trainer:create_data:488 - 数据字典生成完成！
[2024-08-14 09:11:46 INFO   ] trainer:create_data:490 - ======================================================================
[2024-08-14 09:11:47 INFO   ] normalizer:compute_mean_istd:62 - 开始抽取78955条数据计算均值和标准值...
  0%|                                                                                                                                               | 0/9870 [00:00<?, ?it/s]
W0814 09:11:47.533372 39673 system_allocator.cc:231] cudaHostAlloc failed.
W0814 09:11:47.533454 39673 naive_best_fit_allocator.cc:387] cudaHostAlloc Cannot allocate 320 bytes in CUDAPinnedPlace

--------------------------------------
C++ Traceback (most recent call last):
--------------------------------------
0   std::thread::_State_impl<std::thread::_Invoker<std::tuple<ThreadPool::ThreadPool(unsigned long)::{lambda()#1}> > >::_M_run()
1   std::__future_base::_State_baseV2::_M_do_set(std::function<std::unique_ptr<std::__future_base::_Result_base, std::__future_base::_Result_base::_Deleter> ()>*, bool*)
2   void paddle::memory::Copy<phi::GPUPinnedPlace, phi::Place>(phi::GPUPinnedPlace, void*, phi::Place, void const*, unsigned long)
3   void paddle::memory::Copy<phi::Place, phi::Place>(phi::Place, void*, phi::Place, void const*, unsigned long, void*)
4   void paddle::memory::Copy<phi::GPUPinnedPlace, phi::CPUPlace>(phi::GPUPinnedPlace, void*, phi::CPUPlace, void const*, unsigned long)

----------------------
Error Message Summary:
----------------------
FatalError: `Segmentation fault` is detected by the operating system.
  [TimeInfo: *** Aborted at 1723597907 (unix time) try "date -d @1723597907" if you are using GNU date ***]
  [SignalInfo: *** SIGSEGV (@0x10) received by PID 39503 (TID 0x7f05a7fff700) from PID 16 ***]

段错误(吐核)

我把线程个数也改成1还不行

GPU显存足够的

+-----------------------------------------------------------------------------+
| NVIDIA-SMI 515.48.07    Driver Version: 515.48.07    CUDA Version: 11.7     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  NVIDIA A100 80G...  Off  | 00000000:4B:00.0 Off |                    0 |
| N/A   84C    P0    89W / 300W |  17294MiB / 81920MiB |      0%      Default |
|                               |                      |             Disabled |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A     21247      C   ...nvs/paddle_env/bin/python     2265MiB |
|    0   N/A  N/A     21476      C   ...nvs/paddle_env/bin/python     2481MiB |
|    0   N/A  N/A     27231      C   ...nvs/paddle_env/bin/python     7925MiB | 

CUDA Running cuda版本11.6

[yeyupiaoling]

我把线程个数也改成1还不行

改成0试试。你的是什么系统？

[account15222]

我把线程个数也改成1还不行

改成0试试。你的是什么系统？

可以了