mlcommons / training

Reference implementations of MLPerf™ training benchmarks
https://mlcommons.org/en/groups/training
Apache License 2.0
1.61k stars 557 forks source link

[speech_recognition]'IOError: Cannot assign requested address'. Changing download-site in speech_recognition workload #45

Closed linrio closed 1 year ago

linrio commented 6 years ago

The download site of openfst-1.6.7.tar.gz and boost_1_63_0.tar.gz may not be reach in ctcdecode for Chinese. It would throw error just like:

Step 12/14 : RUN git clone --recursive https://github.com/parlance/ctcdecode.git
 ---> Using cache
 ---> 716635b0cded
Step 13/14 : RUN cd ctcdecode; pip install .
 ---> Running in eb02ef7ba1f6
Processing /tmp/ctcdecode
    Complete output from command python setup.py egg_info:
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-req-build-SmXxlu/setup.py", line 55, in <module>
        os.path.join(this_file, "build.py:ffi")
      File "/usr/lib/python2.7/distutils/core.py", line 111, in setup
        _setup_distribution = dist = klass(attrs)
      File "/usr/lib/python2.7/dist-packages/setuptools/dist.py", line 272, in __init__
        _Distribution.__init__(self,attrs)
      File "/usr/lib/python2.7/distutils/dist.py", line 287, in __init__
        self.finalize_options()
      File "/usr/lib/python2.7/dist-packages/setuptools/dist.py", line 327, in finalize_options
        ep.load()(self, ep.name, value)
      File "/usr/local/lib/python2.7/dist-packages/cffi/setuptools_ext.py", line 204, in cffi_modules
        add_cffi_module(dist, cffi_module)
      File "/usr/local/lib/python2.7/dist-packages/cffi/setuptools_ext.py", line 49, in add_cffi_module
        execfile(build_file_name, mod_vars)
      File "/usr/local/lib/python2.7/dist-packages/cffi/setuptools_ext.py", line 25, in execfile
        exec(code, glob, glob)
      File "/tmp/pip-req-build-SmXxlu/build.py", line 22, in <module>
        'third_party/openfst-1.6.7.tar.gz')
      File "/tmp/pip-req-build-SmXxlu/build.py", line 14, in download_extract
        out=dl_path)
      File "/usr/local/lib/python2.7/dist-packages/wget.py", line 526, in download
        (tmpfile, headers) = ulib.urlretrieve(binurl, tmpfile, callback)
      File "/usr/lib/python2.7/urllib.py", line 98, in urlretrieve
        return opener.retrieve(url, filename, reporthook, data)
      File "/usr/lib/python2.7/urllib.py", line 245, in retrieve
        fp = self.open(url, data)
      File "/usr/lib/python2.7/urllib.py", line 213, in open
        return getattr(self, name)(url)
      File "/usr/lib/python2.7/urllib.py", line 443, in open_https
        h.endheaders(data)
      File "/usr/lib/python2.7/httplib.py", line 1053, in endheaders
        self._send_output(message_body)
      File "/usr/lib/python2.7/httplib.py", line 897, in _send_output
        self.send(msg)
      File "/usr/lib/python2.7/httplib.py", line 859, in send
        self.connect()
      File "/usr/lib/python2.7/httplib.py", line 1270, in connect
        HTTPConnection.connect(self)
      File "/usr/lib/python2.7/httplib.py", line 836, in connect
        self.timeout, self.source_address)
      File "/usr/lib/python2.7/socket.py", line 575, in create_connection
        raise err
    IOError: [Errno socket error] [Errno 99] Cannot assign requested address

    ----------------------------------------
Command "python setup.py egg_info" failed with error code 1 in /tmp/pip-req-build-SmXxlu/

For Chinese users I suggest that you can change the file ~/speech_recognition/pytorch/docker/Dockerfile.gpu line59:

RUN git clone --recursive https://github.com/parlance/ctcdecode.git

to:

RUN git clone --recursive -b linrio-patch-1 https://github.com/linrio/ctcdecode.git

Thus you can download the openfst-1.6.7 and boost_1_63_0 reachablely and then complete installing ctcdecode, build-docker.

More info: branch linrio-patch-1in linrio/ctcdecode

bitfort commented 6 years ago

Interesting, we're taking a look.

peladodigital commented 1 year ago

In an effort to clean up the git repo so we can maintain it better going forward, the MLPerf Training working group is closing out issues older than 2 years, since much has changed in the benchmark suite. If you think this issue is still relevant, please feel free to reopen. Even better, please come to the working group meeting to discuss your issue.