Closed NavinKumarMNK closed 7 months ago
This branch is 3 commits ahead of, 860 commits behind openai/triton:main.
Please reproduce with Triton at HEAD; we can't debug something that's months old and could well be fixed at HEAD.
Also please include the output of running Triton with MLIR_ENABLE_DUMP=1 so that we can reproduce this without installing Mixtral.
I would suggest closing the bugs you opened against Mixtral and LLVM, this is extremely unlikely to be a bug in those projects.
Thanks! alright, so this might be the bug in triton. i will close them. i will update with the results asap
The output with MLIR_ENABLE_DUMP=1
is so big, so i am attaching it as txt file
sha256: 39fd4760333ba94d4fd7af76bf9598c15065f476d5efef5168dbe7a67dcc11ad
mlir_output.txt
let me know if anything else is needed.
while building triton HEAD commit with llvm pinned commit
-- Found Python: /root/miniconda3/bin/python3.10 (found version "3.10.13") found components: Interpreter
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
-- Found Threads: TRUE
-- Configuring done (8.2s)
-- Generating done (0.3s)
-- Build files have been written to: /root/triton/build
[ 0%] Building AttrInterfaces.cpp.inc...
[ 1%] Building AttrInterfaces.h.inc...
[ 1%] Building Ops.h.inc...
[ 2%] Building Ops.cpp.inc...
[ 2%] Building OpsEnums.h.inc...
[ 3%] Building OpsEnums.cpp.inc...
[ 3%] Building Dialect.h.inc...
[ 4%] Building Dialect.cpp.inc...
[ 4%] Building Types.h.inc...
[ 6%] Building Types.cpp.inc...
[ 6%] Building TritonTypeInterfaces.h.inc...
[ 7%] Building TritonTypeInterfaces.cpp.inc...
[ 7%] Built target TritonTableGen
[ 7%] Building CXX object lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Dialect.cpp.o
[ 8%] Building CXX object lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Ops.cpp.o
In file included from /root/triton/include/triton/Dialect/TritonGPU/IR/Attributes.h:4,
from /root/triton/lib/Dialect/Triton/IR/Ops.cpp:10:
/root/triton/include/triton/Dialect/TritonGPU/IR/TritonGPUInterfaces.h:4:10: fatal error: triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc: No such file or directory
4 | #include "triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc"
| ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[2]: *** [lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/build.make:90: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Ops.cpp.o] Error 1
make[1]: *** [CMakeFiles/Makefile2:2587: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/all] Error 2
make: *** [Makefile:146: all] Error 2
root@9666068f9a2d:~/triton/build#
The README explains why this does not work.
i couldn't get you. how this is related to anything mentioned in README.md. can you give me some more clarity
Please see the third sentence in the README section which explains how to build with a custom LLVM. I assume you read this section because you figured out how to build Triton with a custom LLVM. It will explain why you're getting an error when you use a pinned LLVM version.
Actually something else may be wrong.
/root/triton/include/triton/Dialect/TritonGPU/IR/TritonGPUInterfaces.h:4:10: fatal error: triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc: No such file or directory
4 | #include "triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc"
I don't know why you're getting this error. Perhaps you need to do a clean build.
can you say what a clean built means. and how the term clean
can violated in normal cases.
i have done the clean build
FROM pytorch AS pytorch-triton
WORKDIR /root/
RUN git clone https://github.com/llvm/llvm-project
RUN apt-get install -y clang lld
WORKDIR /root/llvm-project
RUN git checkout 6f44bb7717897191be25aa01161831c67cdf5b84
RUN mkdir build
WORKDIR ./build
RUN rm -rf /root/miniconda3/lib/libz.so.1 && \
rm -rf /root/miniconda3/lib/libxml2.so.2
RUN cmake -G Ninja -DCMAKE_BUILD_TYPE=Release -DLLVM_ENABLE_ASSERTIONS=ON ../llvm -DLLVM_ENABLE_PROJECTS="mlir;llvm"
RUN ninja && ninja install
RUN rm -rf /usr/lib/llvm-14/
ENV LLVM_EXTERNAL_LIT=/root/llvm-project/build/bin/llvm-lit
ENV LLVM_BUILD_DIR=/root/llvm-project/build/
WORKDIR /root/
RUN git clone https://github.com/pybind/pybind11.git
RUN pip install pytest
WORKDIR /root/pybind11
RUN mkdir build
WORKDIR /root/pybind11/build
RUN cmake .. && make check && make install
# install triton
WORKDIR /root/
RUN git clone https://github.com/NavinKumarMNK/triton.git. # (current HEAD)
WORKDIR /root/triton/
RUN mkdir build
WORKDIR ./build
RUN cmake .. && make
RUN git clone https://github.com/NavinKumarMNK/triton.git. # (current HEAD)
WORKDIR /root/triton/
RUN mkdir build
WORKDIR ./build
RUN cmake .. && make
This does not match the instructions for building Triton from source https://github.com/openai/triton?tab=readme-ov-file#install-from-source.
I have limited time and I need to go assist other users with their issues. I recommend you visit the Triton Slack, which is a good place to go for people who need extra assistance.
alright thanks. installing thought setup.py has some problem since there is no ppc64le support. i am fixing it. and i will try to get back to you after all were done.
I successfully installed triton (HEAD commit) with its pinned llvm with the same procedure. i endup getting the below issue as error https://github.com/openai/triton/issues/3448
/root/triton/include/triton/Dialect/TritonGPU/IR/TritonGPUInterfaces.h:4:10: fatal error: > triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc: No such file or directory 4 | #include "triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc"
This is typically a missing CMake dependency. This file is generated by TritonGPUAttrDefsIncGen
and every file that transitively include it should also have a DEPENDS
to this target (or TritonGPUIR
)
Unfortunately you're not providing enough context for this error for me to easily pin point where is it missing.
Seems like TritonIR
in lib/Dialect/Triton/IR/Ops.cpp
has #include "triton/Dialect/TritonGPU/IR/Attributes.h"
but does not specify a DEPENDS
on anything from GPUIR I believe.
By the way, recent ninja
version can detect this with ninja -t missingdeps
after a successful clean build.
This is first time I am working in this area. I am not clear whats happening. Thats the reason i couldn't provide much details. Let me know in which way i can help.
I hope below log is the what you need. I am not using AMDGPU
tho
root@0be44c460d94:~/triton/python/build/cmake.linux-ppc64le-cpython-3.10# ninja -t missingdeps
Missing dep: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Ops.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Ops.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Traits.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Traits.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Traits.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Traits.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/IR/CMakeFiles/TritonIR.dir/Traits.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/Combine.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/Combine.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/Combine.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/Combine.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/Combine.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/RewriteTensorPointer.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/RewriteTensorPointer.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/RewriteTensorPointer.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/RewriteTensorPointer.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: lib/Dialect/Triton/Transforms/CMakeFiles/TritonTransforms.dir/RewriteTensorPointer.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/TritonTypeInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/TritonNvidiaGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/NVGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/NVGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/NVGPU/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/NVGPU/IR/NVGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/TritonTypeInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/Transforms/Passes.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/AccelerateAMDMatmul.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/TritonNvidiaGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/TritonTypeInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/Transforms/Passes.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/DecomposeConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/TritonNvidiaGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/TritonTypeInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/Transforms/Passes.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/OptimizeEpilogue.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/TritonNvidiaGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/TritonTypeInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/RemoveLayoutConversions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/TritonNvidiaGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/TritonTypeInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/Transforms/Passes.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/ReorderInstructions.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/TritonNvidiaGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/OpsEnums.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/TritonTypeInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/Triton/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonGPU/IR/TritonGPUAttrInterfaces.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Dialect.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Ops.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/Types.h.inc (generated by CUSTOM_COMMAND)
Missing dep: third_party/amd/lib/TritonAMDGPUTransforms/CMakeFiles/TritonAMDGPUTransforms.dir/StreamPipeline.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/TritonNvidiaGPU/IR/TritonNvidiaGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
Processed 346 nodes.
Error: There are 11 missing dependency paths.
11 targets had depfile dependencies on 19 distinct generated inputs (from 1 rules) without a non-depfile dep path to the generator.
There might be build flakiness if any of the targets listed above are built alone, or not late enough, in a clean output directory.
As you noted there were missing dependancies, what can be done to solve this?
The missing dependencies need to be added to CMakeLists.txt.
For example: Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/NVGPU/IR/NVGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
This indicates that the target that builds NVGPUToLLVMPass.cpp is missing a dependency on the target that generates NVGPUAttrDefs.h.inc (I would use TritonGPUIR).
That would be here: https://github.com/openai/triton/blob/main/third_party/nvidia/lib/NVGPUToLLVM/CMakeLists.txt#L5
I almost understood whats happening but not sure about the code changes need to be made. It will be helpful if you can mention the changes need to be done. I will try building it again with the changes.
I think i need to add this add_dependencies(NVGPUToLLVM TritonGPUIR)
to CMakeLists.txt.
please correct me if i am wrong
Just to mention,
i tried this https://github.com/intel/opencl-clang/issues/188 today, since this looks similar to my issue, but then after following this, when i import the triton
the core got dumped with the error, llvm is linked in two places and python3 exited. seems like this might be helpful to you and let me know if i need to try something regarding this procedure.
root@93024fd18a48:/opt# python3
Python 3.10.13 | packaged by conda-forge | (main, Dec 23 2023, 16:04:32) [GCC 12.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import triton
: CommandLine Error: Option 'print-pipeline-passes' registered more than once!
LLVM ERROR: inconsistency in registered CommandLine options
Aborted (core dumped)
I think i need to add this
add_dependencies(NVGPUToLLVM TritonGPUIR)
to CMakeLists.txt. please correct me if i am wrong
Almost: I provided a link to the CMakeLists where you have:
add_triton_library(NVGPUToLLVM
NVGPUToLLVMPass.cpp
DEPENDS
NVGPUConversionPassIncGen
)
You have the "DEPENDS" list here, this is where to append the missing library, so the fix for this missing dependency would be:
add_triton_library(NVGPUToLLVM
NVGPUToLLVMPass.cpp
DEPENDS
NVGPUConversionPassIncGen
TritonGPUIR
)
I get the same missing dependacy logs
...
Missing dep: third_party/nvidia/lib/NVGPUToLLVM/CMakeFiles/NVGPUToLLVM.dir/NVGPUToLLVMPass.cpp.o uses /root/triton/python/build/cmake.linux-ppc64le-cpython-3.10/include/triton/Dialect/NVGPU/IR/NVGPUAttrDefs.h.inc (generated by CUSTOM_COMMAND)
...
Processed 346 nodes.
Error: There are 11 missing dependency paths.
11 targets had depfile dependencies on 19 distinct generated inputs (from 1 rules) without a non-depfile dep path to the generator.
There might be build flakiness if any of the targets listed above are built alone, or not late enough, in a clean output directory.
root@4e8d4724af01:~/triton/python/build/cmake.linux-ppc64le-cpython-3.10# cat ~/triton/third_party/nvidia/lib/NVGPUToLLVM/CMakeLists.txt
add_triton_library(NVGPUToLLVM
NVGPUToLLVMPass.cpp
DEPENDS
NVGPUConversionPassIncGen
TritonGPUIR
)
root@4e8d4724af01:~/triton/python/build/cmake.linux-ppc64le-cpython-3.10# python3
Python 3.10.13 | packaged by conda-forge | (main, Dec 23 2023, 16:04:32) [GCC 12.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import triton
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/root/triton/python/triton/__init__.py", line 8, in <module>
from .runtime import (
File "/root/triton/python/triton/runtime/__init__.py", line 1, in <module>
from .autotuner import (Autotuner, Config, Heuristics, autotune, heuristics)
File "/root/triton/python/triton/runtime/autotuner.py", line 7, in <module>
from ..testing import do_bench
File "/root/triton/python/triton/testing.py", line 7, in <module>
from . import language as tl
File "/root/triton/python/triton/language/__init__.py", line 4, in <module>
from . import math
File "/root/triton/python/triton/language/math.py", line 1, in <module>
from . import core
File "/root/triton/python/triton/language/core.py", line 9, in <module>
from ..runtime.jit import jit
File "/root/triton/python/triton/runtime/jit.py", line 11, in <module>
from ..runtime.driver import driver
File "/root/triton/python/triton/runtime/driver.py", line 1, in <module>
from ..backends import backends
File "/root/triton/python/triton/backends/__init__.py", line 50, in <module>
backends = _discover_backends()
File "/root/triton/python/triton/backends/__init__.py", line 43, in _discover_backends
compiler = _load_module(name, os.path.join(root, name, 'compiler.py'))
File "/root/triton/python/triton/backends/__init__.py", line 12, in _load_module
spec.loader.exec_module(module)
File "/root/triton/python/triton/backends/nvidia/compiler.py", line 2, in <module>
from triton._C.libtriton import ir, passes, llvm, nvidia
ImportError: /root/triton/python/triton/_C/libtriton.so: undefined symbol: LLVMInitializeSparcTarget
Did you first build before checking the missing deps? I believe ninja needs a clean build for this since it'll use it's build log.
Your current environment
llvm build commit : c5dede880d175f7229c9b2923f4753e12702305d
build command
Bug
example.py. - i loaded the mixtral-8x7b-instruct fp16 model
I built triton==2.1.0 from source. my fork of triton : https://github.com/NavinKumarMNK/triton that i used to build from source.
llvm installation
triton installation from my fork
I get this error while only running
Mixtral MoE models
. others models are supported. i raised this issue in both vllm & llvm. https://github.com/vllm-project/vllm/issues/3732 https://github.com/llvm/llvm-project/issues/87089Thank you. let me know if i can give anymore details.