search

mlcommons / inference

Reference implementations of MLPerf™ inference benchmarks
https://mlcommons.org/en/groups/inference
Apache License 2.0
1.18k stars 519 forks source link

RNNT fails with below error when using numpy 1.24 #1320

Closed arjunsuresh closed 1 year ago

arjunsuresh commented 1 year ago

With numpy 1.24 we are getting the below error while running rnnt reference implementation. It works fine with numpy 1.21. 

CMD: cd '/home/arjun/CM/repos/local/cache/a127f06d39034768/inference/speech_recognition/rnnt' && /usr/bin/python3 run.py --backend pytorch --scenario Offline --manifest /home/arjun/CM/repos/local/cache/1cef4ccff6344b6c/dev-clean-wav.json --dataset_dir /home/arjun/CM/repos/local/cache/1cef4ccff6344b6c/dev-clean-wav/.. --pytorch_config_toml pytorch/configs/rnnt.toml --pytorch_checkpoint /home/arjun/CM/repos/local/cache/c25ad4bc302f4607/DistributedDataParallel_1576581068.9962234-epoch-100.pt --log_dir /home/arjun/CM/repos/octoml@ck/cm-mlops/script/app-mlperf-inference/test_results/pytorch-gpu/rnnt/offline/accuracy --mlperf_conf '/home/arjun/CM/repos/local/cache/a127f06d39034768/inference/mlperf.conf' --user_conf '/home/arjun/CM/repos/octoml@ck/cm-mlops/script/app-mlperf-inference/tmp/58eb2b938ae34c97b2cf75dbc863762f.conf' --accuracy
Traceback (most recent call last):
  File "/home/arjun/CM/repos/local/cache/a127f06d39034768/inference/speech_recognition/rnnt/run.py", line 91, in <module>
    main()
  File "/home/arjun/CM/repos/local/cache/a127f06d39034768/inference/speech_recognition/rnnt/run.py", line 55, in main
    from pytorch_SUT import PytorchSUT
  File "/home/arjun/CM/repos/local/cache/a127f06d39034768/inference/speech_recognition/rnnt/pytorch_SUT.py", line 26, in <module>
    from QSL import AudioQSL, AudioQSLInMemory
  File "/home/arjun/CM/repos/local/cache/a127f06d39034768/inference/speech_recognition/rnnt/QSL.py", line 6, in <module>
    from parts.segment import AudioSegment
  File "/home/arjun/CM/repos/local/cache/a127f06d39034768/inference/speech_recognition/rnnt/pytorch/parts/segment.py", line 16, in <module>
    import librosa
  File "/home/arjun/.local/lib/python3.10/site-packages/librosa/__init__.py", line 209, in <module>
    from . import core
  File "/home/arjun/.local/lib/python3.10/site-packages/librosa/core/__init__.py", line 5, in <module>
    from .convert import *  # pylint: disable=wildcard-import
  File "/home/arjun/.local/lib/python3.10/site-packages/librosa/core/convert.py", line 7, in <module>
    from . import notation
  File "/home/arjun/.local/lib/python3.10/site-packages/librosa/core/notation.py", line 8, in <module>
    from ..util.exceptions import ParameterError
  File "/home/arjun/.local/lib/python3.10/site-packages/librosa/util/__init__.py", line 77, in <module>
    from .utils import *  # pylint: disable=wildcard-import
  File "/home/arjun/.local/lib/python3.10/site-packages/librosa/util/utils.py", line 9, in <module>
    import numba
  File "/home/arjun/.local/lib/python3.10/site-packages/numba/__init__.py", line 42, in <module>
    from numba.np.ufunc import (vectorize, guvectorize, threading_layer,
  File "/home/arjun/.local/lib/python3.10/site-packages/numba/np/ufunc/__init__.py", line 3, in <module>
    from numba.np.ufunc.decorators import Vectorize, GUVectorize, vectorize, guvectorize
  File "/home/arjun/.local/lib/python3.10/site-packages/numba/np/ufunc/decorators.py", line 3, in <module>
    from numba.np.ufunc import _internal
SystemError: initialization of _internal failed without raising an exception
arjunsuresh commented 1 year ago

This issue is not seen with the latest numpy.