Maxzor
commented
2 years ago Traceback (most recent call last):
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/Parallel.py", line 51, in apply_print_exception
return func(*args)
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/TensileCreateLibrary.py", line 192, in buildSourceCodeObjectFile
listing = subprocess.check_output(bundlerArgs, stderr=subprocess.STDOUT).decode().split("\n")
File "/usr/lib/python3.9/subprocess.py", line 424, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/lib/python3.9/subprocess.py", line 505, in run
with Popen(*popenargs, **kwargs) as process:
File "/usr/lib/python3.9/subprocess.py", line 951, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "/usr/lib/python3.9/subprocess.py", line 1696, in _execute_child
and os.path.dirname(executable)
File "/usr/lib/python3.9/posixpath.py", line 152, in dirname
p = os.fspath(p)
TypeError: expected str, bytes or os.PathLike object, not NoneType
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
File "/usr/lib/python3.9/multiprocessing/pool.py", line 125, in worker
result = (True, func(*args, **kwds))
File "/usr/lib/python3.9/multiprocessing/pool.py", line 51, in starmapstar
return list(itertools.starmap(args[0], args[1]))
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/Parallel.py", line 51, in apply_print_exception
return func(*args)
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/TensileCreateLibrary.py", line 192, in buildSourceCodeObjectFile
listing = subprocess.check_output(bundlerArgs, stderr=subprocess.STDOUT).decode().split("\n")
File "/usr/lib/python3.9/subprocess.py", line 424, in check_output
return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
File "/usr/lib/python3.9/subprocess.py", line 505, in run
with Popen(*popenargs, **kwargs) as process:
File "/usr/lib/python3.9/subprocess.py", line 951, in __init__
self._execute_child(args, executable, preexec_fn, close_fds,
File "/usr/lib/python3.9/subprocess.py", line 1696, in _execute_child
and os.path.dirname(executable)
File "/usr/lib/python3.9/posixpath.py", line 152, in dirname
p = os.fspath(p)
TypeError: expected str, bytes or os.PathLike object, not NoneType
"""
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/root/rocBLAS-rocm-4.5.0/build/library/src/../../virtualenv/lib/python3.9/site-packages/Tensile/bin/TensileCreateLibrary", line 38, in <module>
TensileCreateLibrary()
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/TensileCreateLibrary.py", line 1549, in TensileCreateLibrary
codeObjectFiles = writeSolutionsAndKernels(outputPath, CxxCompiler, problemTypes, solutions,
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/TensileCreateLibrary.py", line 501, in writeSolutionsAndKernels
codeObjectFiles += buildSourceCodeObjectFiles(CxxCompiler, kernelFiles, outputPath)
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/TensileCreateLibrary.py", line 241, in buildSourceCodeObjectFiles
coFiles = Common.ParallelMap(buildSourceCodeObjectFile, args, "Compiling source kernels",
File "/root/rocBLAS-rocm-4.5.0/build/virtualenv/lib/python3.9/site-packages/Tensile/Parallel.py", line 122, in ParallelMap
rv = mapFunc(function, objects)
File "/usr/lib/python3.9/multiprocessing/pool.py", line 372, in starmap
return self._map_async(func, iterable, starmapstar, chunksize).get()
File "/usr/lib/python3.9/multiprocessing/pool.py", line 771, in get
raise self._value
cgmb
Hello, This is about a packaging effort of 4.5.2 in Debian. I have a few issues when using llvm-13 instead of the llvm-project from AMD. I am giving a try at unbundling this llvm fork before giving up and packaging it with the other rocm components.
First https://github.com/ROCmSoftwarePlatform/Tensile/commit/2dc5821f3c013e55726cf1d2bab86f1d32b12908 is a bit bold to assume, given the weakness of the distribution of the platform, that hip executables are in the path :). Second I don't have hcc-config but just hcc and hipconfig, symlinking hcc-config to hipconfig seems fine.
Third, the compilation of rocblas fails, I don't know if this is a problem in tensile or roccblas, below is the stack trace that gives, after a long time stuck on one process left, when compiling kernels. Here is the environment where I tinkered this compilation. Forgive the mess :) This is basically @cgmb 's all-in-one build script, combined with the mini docker-builder that I'm using to help me package. With amd-llvm switched out, comgr patched to work with llvm-13, and the parallel-job flags removed. Would you have any clue? Best regards, Maxime