search

ParRes / Kernels

This is a set of simple programs that can be used to explore the features of a parallel platform.
https://groups.google.com/forum/#!forum/parallel-research-kernels
Other
404 stars 106 forks source link

transpose-petsc crashes #615

Closed s-sajid-ali closed 1 year ago

s-sajid-ali commented 1 year ago

What type of issue is this?

Where does this bug appear?

Check all that apply:

Compiler

clang-15.0.3

PRK build information

make.defs

``` sasyed@MAC-140753 ~/D/p/K/C1z (sajid/rust_rayon)> cat ../common/make.defs # # This file shows the LLVM toolchain options for PRKs using # OpenMP, MPI and/or Fortran coarrays only. # # Base compilers and language options # LLVM_ROOT=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/apple-clang-14.0.0/llvm-15.0.3-rf5hmf4bztv7myrfwppseo4kdjb6oqat/ #LLVM_PATH=${LLVM_ROOT}/bin/ LLVM_PATH=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/apple-clang-14.0.0/llvm-15.0.3-rf5hmf4bztv7myrfwppseo4kdjb6oqat/bin/ #CLANG_VERSION=-9 # C99 is required in some implementations. CC=${LLVM_PATH}clang${CLANG_VERSION} -std=c11 -pthread # All of the Fortran code is written for the 2008 standard and requires preprocessing. #FC=/opt/llvm/pgi-flang/bin/flang -Mpreprocess -Mfreeform -L/opt/llvm/pgi-flang/lib -Wl,-rpath=/opt/llvm/pgi-flang/lib FC=${LLVM_PATH}flang-new # C++11 may not be required but does no harm here. CXX=${LLVM_PATH}clang++${CLANG_VERSION} -std=c++17 -march=native -mtune=native -stdlib=libc++ -L/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/lib # # Compiler flags # # -mtune=native is appropriate for most cases. # -march=native is appropriate if you want portable binaries. # DEFAULT_OPT_FLAGS=-g -O3 -ffast-math --sysroot=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk #DEFAULT_OPT_FLAGS+=-mllvm -polly -mllvm -polly-vectorizer=stripmine # # If you want to be specific, get the architecture options from: # ${LLVM_PATH}llc --version # and then get the CPU/ISA options from (e.g. for x86-64): # ${LLVM_PATH}llc -march=x86-64 -mcpu=help # # These are useful to understand why the compiler does not vectorize loops: # DEFAULT_OPT_FLAGS+=-Rpass-analysis=loop-vectorize # DEFAULT_OPT_FLAGS+=-Rpass=loop-vectorize #DEFAULT_OPT_FLAGS+=-fopt-info-vec-missed DEFAULT_OPT_FLAGS+=-Wall #-Werror #DEFAULT_OPT_FLAGS+=-Wno-ignored-attributes -Wno-deprecated-declarations #DEFAULT_OPT_FLAGS+=-mavx -mfma # # OpenMP flags # OPENMPFLAG=-fopenmp=libomp OPENMPSIMDFLAG=-fopenmp-simd OFFLOADFLAG=-fopenmp OFFLOADFLAG+=-DGPU_SCHEDULE="" OPENACCFLAG=-fopenacc # Klondike weirdness # OPENMPFLAG+=-L/opt/intel/compilers_and_libraries_2018.0.082/linux/compiler/lib/intel64_lin -liomp5 # Mac weirdness #OPENMPFLAG+=-L${LLVM_ROOT}lib # LLVM # OPENMPFLAG+=-L/opt/llvm/4.0.0/lib -lomp # # OpenCL flags # # MacOS OPENCLFLAG=-framework OpenCL # POCL # http://portablecl.org/docs/html/using.html#linking-your-program-directly-with-pocl is not correct... #OPENCLFLAG=-I/opt/pocl/latest/include -L/opt/pocl/latest/lib -lpoclu -I/opt/pocl/latest/share/pocl/include -lOpenCL # Linux #OPENCLDIR=/etc/alternatives #OPENCLDIR=/etc/alternatives/opencl-intel-tools #OPENCLFLAG=-I${OPENCLDIR} -L${OPENCLDIR}/lib64 -lOpenCL #OPENCLFLAG+=-Wno-ignored-attributes #OPENCLFLAG+=-Wno-deprecated-declarations #OPENCLFLAG+=-Wno-missing-braces # oneAPI #OPENCLDIR=/opt/intel/oneapi/compiler/latest/linux #OPENCLFLAG=-I${OPENCLDIR}/include/sycl -L${OPENCLDIR}/lib -lOpenCL OPENCLFLAG+=-DCL_TARGET_OPENCL_VERSION=220 # # Metal (MacOS-only, unused) # #METALFLAG=-framework MetalPerformanceShaders # # OCCA # #OCCADIR=${HOME}/prk-repo/Cxx11/occa # # SYCL flags # # Intel SYCL - https://github.com/intel/llvm/blob/sycl/sycl/doc/GetStartedWithSYCLCompiler.md # #SYCLDIR=/opt/isycl #SYCLDIR=${HOME}/ISYCL/llvm/build #SYCLCXX=${SYCLDIR}/bin/clang++ #SYCLFLAG=-std=c++17 -O3 #SYCLFLAG+=-fsycl -fsycl-unnamed-lambda #SYCLFLAG+=-L${SYCLDIR}/lib -lsycl -Wl,-rpath=${SYCLDIR}/lib # # Intel oneAPI # #SYCLCXX=dpcpp #SYCLFLAG=-fsycl #SYCLFLAG+=-std=c++17 -O3 #SYCLFLAG+=--gcc-toolchain=/opt/rh/devtoolset-7/root/usr #SYCLFLAG+=-D_GLIBCXX_USE_CXX11_ABI=1 #SYCLFLAG+=-stdlib=c++ # # CodePlay ComputeCpp # #SYCLDIR=/opt/sycl/latest SYCLDIR=/opt/codeplay/latest SYCLCXX=${SYCLDIR}/bin/compute++ SYCLFLAG=-std=c++17 -O3 SYCLFLAG+=-sycl-driver SYCLFLAG+=-Wsycl-pedantic # USM-related SYCLFLAG+=-DSYCL_LANGUAGE_VERSION=2020 SYCLFLAG+=-fno-sycl-address-space # This makes a huge difference in e.g. nstream... SYCLFLAG+=-no-serial-memop # SPIR target SYCLFLAG+=-sycl-target spir64 # NVIDIA target #SYCLFLAG+=-sycl-target ptx64 #SYCLFLAG+=-DPRK_NO_OPENCL_GPU SYCLFLAG+=-I$(SYCLDIR)/include -L$(SYCLDIR)/lib -Wl,-rpath=$(SYCLDIR)/lib -lComputeCpp # If not found automatically SYCLFLAG+=${OPENCLFLAG} # These are only necessary on systems with very old GCC as the default # CentOS7 and Ubuntu14 built for this #SYCLFLAG+=-D_GLIBCXX_USE_CXX11_ABI=0 # PRK header rejects GCC4 #SYCLFLAG+=--gcc-toolchain=/swtools/gcc/5.4.0 # # triSYCL # # https://github.com/triSYCL/triSYCL is header-only so just clone in Cxx11 directory... #SYCLDIR=./triSYCL #SYCLCXX=${CXX} $(DEFAULT_OPT_FLAGS) #SYCLFLAG=-std=c++17 -I$(SYCLDIR)/include -DTRISYCL # # hipSYCL # #SYCLDIR=/opt/hipsycl/usr/local # if installed with DESTDIR #SYCLDIR=/opt/hipSYCL #SYCLDIR=/opt/spack/spack/opt/spack/linux-ubuntu18.04-haswell/gcc-8.3.0/hipsycl-master-appurj662qod4y4z5zxipr2fwthl66k7 #SYCLCXX=${SYCLDIR}/bin/syclcc-clang #SYCLFLAG=-std=c++17 -O3 #SYCLFLAG+=-DHIPSYCL # CPU platform #SYCLFLAG+=--hipsycl-platform=cpu #SYCLFLAG+=--hipsycl-platform=cuda #SYCLFLAG+=--hipsycl-gpu-arch=sm_60 #SYCLFLAG+=-Wl,-rpath=/opt/hipSYCL/llvm/lib # wrong? #SYCLFLAG+=-Wl,-rpath=${SYCLDIR}/lib # CELERITYDIR=${SYCLDIR} CELERITYINC=-I$(CELERITYDIR)/include/celerity -I$(CELERITYDIR)/include/celerity/vendor CELERITYLIB=-L$(CELERITYDIR)/lib -lcelerity_runtime # # OCCA # #OCCADIR=${HOME}/prk-repo/Cxx11/occa # # TBB # #TBBDIR=/usr/lib/x86_64-linux-gnu TBBDIR=/opt/homebrew/Cellar/tbb/2020_U3_1 TBBFLAG=-I${TBBDIR}/include -L${TBBDIR}/lib -ltbb #TBBDIR=/opt/intel/compilers_and_libraries_2019.2.159/linux/tbb #TBBFLAG=-I${TBBDIR}/include -L${TBBDIR}/lib -L${TBBDIR}/lib/intel64_lin/gcc4.7 -ltbb # # Parallel STL, Boost, etc. # #BOOSTFLAG=-I/usr/local/Cellar/boost/1.72.0/include # old Homebrew #BOOSTFLAG=-I/usr/include/boost169 # Linux BOOSTFLAG=-I/opt/homebrew/Cellar/boost/1.75.0_2/include # new Homebrew BOOSTFLAG+=-DBOOST_COMPUTE_USE_CPP11 # triSYCL requires Boost SYCLFLAG+=${BOOSTFLAG} #RANGEFLAG=-DUSE_BOOST_IRANGE ${BOOSTFLAG} RANGEFLAG=-DUSE_RANGES_TS -I./range-v3/include PSTLFLAG=${OPENMPSIMDFLAG} ${TBBFLAG} ${RANGEFLAG} PSTLFLAG+=-I./llvm-pstl/include -DLLVM_PSTL KOKKOSDIR=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/kokkos-develop-bzvsb46fxj7zsxhdna52kvr7t7mrve57 KOKKOSFLAG=-I${KOKKOSDIR}/include -L${KOKKOSDIR}/lib -lkokkoscontainers -lkokkoscore KOKKOSFLAG+=${OPENMPFLAG} #KOKKOSFLAG+=-DPRK_KOKKOS_BACKEND=Threads # Mac Clang does not support OpenMP RAJADIR=/opt/raja/clang RAJAFLAG=-I${RAJADIR}/include -L${RAJADIR}/lib -lRAJA ${OPENMPFLAG} ${TBBFLAG} THRUSTDIR=/opt/nvidia/thrust THRUSTFLAG=-I${THRUSTDIR} ${RANGEFLAG} EXECUTORSDIR=./libunifex EXECUTORSFLAG=-I${EXECUTORSDIR}/include -I${EXECUTORSDIR}/build/include # HPX is more complicated... HWLOCFLAG=-I/usr/local/include HPXDIR=./hpx HPXCXX=${HPXDIR}/bin/hpxcxx HPXFLAG=-Wno-unused-local-typedef ${HWLOCFLAG} # UPC++ UPCXXDIR=./upcxx UPCXX=${UPCXXDIR}/bin/upcxx UPCXXFLAG=-codemode={O3,debug} UPCXXFLAG+=-std=c++17 UPCXXFLAG+=-mtune=native -ffast-math # # CBLAS for C++ DGEMM # BLASFLAG=-DACCELERATE -framework Accelerate CBLASFLAG=-DACCELERATE -framework Accelerate -flax-vector-conversions #BLASFLAG=-lblas #CBLASFLAG=-lcblas # # CUDA flags # # Mac w/ CUDA emulation via https://github.com/hughperkins/coriander #NVCC=/opt/llvm/cocl/bin/cocl # Linux w/ NVIDIA CUDA NVCC=nvcc -arch=sm_50 CUDAFLAGS=-g -O3 -std=c++11 CUDAFLAGS+=-arch=sm_50 # https://github.com/tensorflow/tensorflow/issues/1066#issuecomment-200574233 CUDAFLAGS+=-D_MWAITXINTRIN_H_INCLUDED # # Halide # HALIDECXX=c++ HALIDEDIR=/opt/halide/Halide-10.0.0-x86-64-linux HALIDEFLAG=-I${HALIDEDIR}/include HALIDEFLAG+=-Wl,-rpath=${HALIDEDIR}/lib -L${HALIDEDIR}/lib -lHalide #HALIDEFLAG+=-D_GLIBCXX_USE_CXX11_ABI=0 HALIDEFLAG+=${DEFAULT_OPT_FLAGS} HALIDEFLAG+=-std=c++17 # # ISPC # ISPC=ispc ISPCFLAG=-O3 --target=host --opt=fast-math # # MPI-3 # MPIDIR=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/mpich-4.0.2-ker7elw3lz6n4hxeehnfdpzimi2z2dno MPICC=${MPIDIR}/bin/mpicc MPICXX=${MPIDIR}/bin/mpicxx MPIFORT=${MPIDIR}/bin/mpifort MPIINC=-I${MPIDIR}/include MPILIB=-L${MPIDIR}/lib -lmpi #MPILIB=-L/usr/local/opt/libevent/lib -L${MPIDIR}/lib -lmpi #MPIINC=-I/usr/include/mpich-3.2-x86_64 #MPILIB=-L/usr/lib64/mpich-3.2/lib -lmpi # # Global Arrays # GADIR=../deps/ga GAFLAG=-I${GADIR}/include GAFLAG+=-L${GADIR}/lib -lga GAFLAG+=-L${GADIR}/../armci-mpi/lib -larmci # ARMCI-MPI #GAFLAG+=-L${GADIR}/lib -larmci -lcomex # ARMCI/ComEx GAFLAG+=${MPIINC} ${MPILIB} GAFLAG+=-lmpifort -lmpi GAFLAG+=${BLASFLAG} GAFLAG+=-fdefault-integer-8 # GA is compiled with 64b integers on 64-bit systems # # PETSc # PETSCDIR=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/petsc-main-7tezij2pm2nfqd2gp4h7marsagm2pyev PETSCFLAG=-I${PETSCDIR}/include PETSCFLAG+=-L${PETSCDIR}/lib -lpetsc #PETSCFLAG+=-Wl,-rpath=${PETSCDIR}/lib # # Fortran 2008 coarrays # # see https://github.com/ParRes/Kernels/blob/master/FORTRAN/README.md for details # single-node COARRAYFLAG=-fcoarray=single -lcaf_single # multi-node #COARRAYFLAG=-fcoarray=lib -L/opt/homebrew/lib -lcaf_mpi #COARRAYFLAG=-fcoarray=lib -L/usr/lib/x86_64-linux-gnu/open-coarrays/mpich/lib -lcaf_mpi # # MEMKIND (used in C1z) # MEMKINDDIR=/home/parallels/PRK/deps MEMKINDFLAGS=-I${MEMKINDDIR}/include -L${MEMKINDDIR}/lib -lmemkind -Wl,-rpath=${MEMKINDDIR}/lib sasyed@MAC-140753 ~/D/p/K/C1z (sajid/rust_rayon)> ```

Output showing problem

error

``` sasyed@MAC-140753 ~/D/p/K/C1z (sajid/rust_rayon)> mpirun -np 16 ./transpose-petsc -i 10 -n 16384 Parallel Research Kernels version 2020 C11/PETSc Transpose: B += A^T Number of processes = 16 Number of iterations = 10 Matrix order = 16384 [0]PETSC ERROR: --------------------- Error Message -------------------------------------------------------------- [0]PETSC ERROR: Invalid argument [0]PETSC ERROR: Reuse matrix used was not generated from call to MatTranspose(). Suggest MatTransposeSetPrecursor(). [0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting. [0]PETSC ERROR: Petsc Development GIT revision: 6635954dd8173df843b7339ae6dcb4387c8413ed GIT Date: 2022-10-31 15:10:02 +0000 [0]PETSC ERROR: ./transpose-petsc on a named MAC-140753 by sasyed Tue Nov 8 18:30:47 2022 [0]PETSC ERROR: Configure options --prefix=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/petsc-main-7tezij2pm2nfqd2gp4h7marsagm2pyev --with-ssl=0 --download-c2html=0 --download-sowing=0 --download-hwloc=0 CFLAGS="-g -O2 -march=native -mtune=native --sysroot=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk" COPTFLAGS= CXXFLAGS="-g -O2 -march=native -mtune=native -stdlib=libc++ --sysroot=/Library/Developer/CommandLineTools/SDKs/MacOSX.sdk" CXXOPTFLAGS= --with-cc=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/mpich-4.0.2-ker7elw3lz6n4hxeehnfdpzimi2z2dno/bin/mpicc --with-cxx=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/mpich-4.0.2-ker7elw3lz6n4hxeehnfdpzimi2z2dno/bin/mpic++ --with-fc=0 --with-precision=double --with-scalar-type=real --with-shared-libraries=1 --with-debugging=0 --with-openmp=0 --with-64-bit-indices=0 --with-blaslapack-lib=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/openblas-develop-3ewuktkilyzygbqtut4uzuav5oygx3a7/lib/libopenblas.dylib --with-x=0 --with-clanguage=C --with-cuda=0 --with-hip=0 --with-metis=1 --with-metis-include=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/metis-5.1.0-vi4baebflozabatrdxscqcsdz4mklnfh/include --with-metis-lib=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/metis-5.1.0-vi4baebflozabatrdxscqcsdz4mklnfh/lib/libmetis.dylib --with-hypre=1 --with-hypre-include=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/hypre-develop-t2oqtu74wphfyeapzf5temy7tmxbpuwa/include --with-hypre-lib=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/hypre-develop-t2oqtu74wphfyeapzf5temy7tmxbpuwa/lib/libHYPRE.a --with-parmetis=1 --with-parmetis-include=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/parmetis-4.0.3-hqyqgs5627sd5lpvl7mosgsviastbmly/include --with-parmetis-lib=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/parmetis-4.0.3-hqyqgs5627sd5lpvl7mosgsviastbmly/lib/libparmetis.dylib --with-kokkos=0 --with-kokkos-kernels=0 --with-superlu_dist=0 --with-ptscotch=0 --with-suitesparse=1 --with-suitesparse-include=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/include --with-suitesparse-lib="/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libumfpack.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libklu.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libcholmod.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libbtf.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libccolamd.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libcolamd.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libcamd.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libamd.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libsuitesparseconfig.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/suite-sparse-5.13.0-h3ndcawn6vss56736dbwtetdsgyi2yj7/lib/libspqr.dylib" --with-hdf5=1 --with-hdf5-include=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/hdf5-1.12.2-pv5nypvhavk3arphwzktw6pkcbwnnguo/include --with-hdf5-lib="/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/hdf5-1.12.2-pv5nypvhavk3arphwzktw6pkcbwnnguo/lib/libhdf5_hl.dylib /Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/hdf5-1.12.2-pv5nypvhavk3arphwzktw6pkcbwnnguo/lib/libhdf5.dylib" --with-zlib=1 --with-zlib-include=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/zlib-1.2.13-x6vbjid2nncym7ppqgn2b47uu6tyhxq4/include --with-zlib-lib=/Users/sasyed/Documents/packages/spack/opt/spack/darwin-monterey-m1/clang-15.0.3/zlib-1.2.13-x6vbjid2nncym7ppqgn2b47uu6tyhxq4/lib/libz.dylib --with-mumps=0 --with-trilinos=0 --with-fftw=0 --with-valgrind=0 --with-gmp=0 --with-libpng=0 --with-giflib=0 --with-mpfr=0 --with-netcdf=0 --with-pnetcdf=0 --with-moab=0 --with-random123=0 --with-exodusii=0 --with-cgns=0 --with-memkind=0 --with-p4est=0 --with-saws=0 --with-yaml=0 --with-hwloc=0 --with-libjpeg=0 --with-scalapack=0 --with-strumpack=0 --with-mmg=0 --with-parmmg=0 --with-tetgen=0 [0]PETSC ERROR: #1 MatTranspose() at /private/var/folders/mb/zd6pgmt100q77s5fhn5xf4jw0000gq/T/sasyed/spack-stage/spack-stage-petsc-main-7tezij2pm2nfqd2gp4h7marsagm2pyev/spack-src/src/mat/interface/matrix.c:5184 [0]PETSC ERROR: #2 main() at transpose-petsc.c:184 [0]PETSC ERROR: PETSc Option Table entries: [0]PETSC ERROR: -i 10 [0]PETSC ERROR: -n 16384 [0]PETSC ERROR: ----------------End of Error Message -------send entire error message to petsc-maint@mcs.anl.gov---------- Abort(62) on node 0 (rank 0 in comm 16): application called MPI_Abort(MPI_COMM_SELF, 62) - process 0 =================================================================================== = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES = PID 30624 RUNNING AT MAC-140753 = EXIT CODE: 9 = CLEANING UP REMAINING PROCESSES = YOU CAN IGNORE THE BELOW CLEANUP MESSAGES =================================================================================== YOUR APPLICATION TERMINATED WITH THE EXIT STRING: Killed: 9 (signal 9) This typically refers to a problem with your application. Please see the FAQ page for debugging suggestions ```

jeffhammond commented 1 year ago

should be fixed but note that there is no verification of transpose-petsc right now. these were never really finished, in part because PETSc Transpose was so poorly implemented for dense matrices when I wrote this initially that it wasn't worth additional effort.