Open zubairahmed-ai opened 2 years ago
c++: internal compiler error: Killed (program cc1plus)
Did your board run out of memory? Do you have extra swap memory mounted?
Not sure how to check it's a 4gb board, I am not sure how I can enable swap memory
I successfully built tensorflow container separately, but building pytorch one separately also gave above error but my assumption is that all
switch builds everything it needs including tensorflow
and pytorch
Even after increasing swap memory to 4Gb I think I am running out of memory and the builds gives the same error as above
Somehow the build exits gracefully now after increasing swap memory showing the massive text in red below
/usr/local/lib/python3.6/dist-packages/setuptools/command/install.py:37: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
setuptools.SetuptoolsDeprecationWarning,
/usr/local/lib/python3.6/dist-packages/setuptools/command/easy_install.py:159: EasyInstallDeprecationWarning: easy_install command is deprecated. Use build and pip and other standards-based tools.
EasyInstallDeprecationWarning,
Traceback (most recent call last):
File "setup.py", line 91, in <module>
zip_safe=False,
File "/usr/local/lib/python3.6/dist-packages/setuptools/__init__.py", line 159, in setup
return distutils.core.setup(**attrs)
File "/usr/lib/python3.6/distutils/core.py", line 148, in setup
dist.run_commands()
File "/usr/lib/python3.6/distutils/dist.py", line 955, in run_commands
self.run_command(cmd)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.6/dist-packages/setuptools/command/install.py", line 74, in run
self.do_egg_install()
File "/usr/local/lib/python3.6/dist-packages/setuptools/command/install.py", line 116, in do_egg_install
self.run_command('bdist_egg')
File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.6/dist-packages/setuptools/command/bdist_egg.py", line 164, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/usr/local/lib/python3.6/dist-packages/setuptools/command/bdist_egg.py", line 150, in call_command
self.run_command(cmdname)
File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/usr/local/lib/python3.6/dist-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/usr/lib/python3.6/distutils/command/install_lib.py", line 109, in build
self.run_command('build_ext')
File "/usr/lib/python3.6/distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/usr/lib/python3.6/distutils/dist.py", line 974, in run_command
cmd_obj.run()
File "/torchaudio/build_tools/setup_helpers/extension.py", line 52, in run
super().run()
File "/usr/local/lib/python3.6/dist-packages/setuptools/command/build_ext.py", line 79, in run
_build_ext.run(self)
File "/usr/local/lib/python3.6/dist-packages/Cython/Distutils/old_build_ext.py", line 186, in run
_build_ext.build_ext.run(self)
File "/usr/lib/python3.6/distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/usr/local/lib/python3.6/dist-packages/Cython/Distutils/old_build_ext.py", line 195, in build_extensions
_build_ext.build_ext.build_extensions(self)
File "/usr/lib/python3.6/distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/usr/lib/python3.6/distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/torchaudio/build_tools/setup_helpers/extension.py", line 99, in build_extension
["cmake", "--build", "."] + build_args, cwd=self.build_temp)
File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--target', 'install']' returned non-zero exit status 1.
Hmm I'm not exactly sure what the actual error is there. If you don't need torchaudio, you could comment that section out of the dockerfile.
Is it possible for you to use one of the existing pre-built l4t-ml container images that are on NGC?
Hmm I'm not exactly sure what the actual error is there. If you don't need torchaudio, you could comment that section out of the dockerfile.
Is it possible for you to use one of the existing pre-built l4t-ml container images that are on NGC?
I actually did comment that out, wish you'd pointed this out earlier, right now I am stuck with following error after commenting torchaudio
Yes its totally possible, let me know how to use those pre-built containers, I am following instructions in your readme
build/temp.linux-aarch64-3.6/scratch/vers.c:4:10: fatal error: zmq.h: No such file or directory
#include "zmq.h"
^~~~~~~
compilation terminated.
error: command 'aarch64-linux-gnu-gcc' failed with exit status 1
Warning: Couldn't find an acceptable libzmq on the system.
Yes its totally possible, let me know how to use those pre-built containers, I am following instructions in your readme
At the top of the readme is a link to the containers on NGC which include instructions on how to run the pre-built images:
oh dear, thanks @dusty-nv will try this out
Hi @dusty-nv I am running
./scripts/docker_build_ml.sh all
afterscripts/docker_run.sh -c nvcr.io/nvidia/l4t-ml:r32.4.4-py3
but when it runs it gives following error withtorchaudio
or I think it is torchaudio This seems similar but not sure how to fix it here. I am stuck, please help