tensorflow / mlir

"Multi-Level Intermediate Representation" Compiler Infrastructure
1.74k stars 260 forks source link

MLIR Regression test failures at HEAD (990677db) #97

Closed ewconnell closed 5 years ago

ewconnell commented 5 years ago

Two of the unit tests fail on the current version. It has been independently reproduced by jpienaar@google.com.

Test configuration

macOS Mojave version: 10.14.3 (18D109) MacBook Pro (13-inch, 2018, Four Thunderbolt 3 Ports) processor 2.3 GHz Intel Core i5 memory 8 GB 2133 MHz LPDDR3 graphics Intel Iris Plus Graphics 655 1536 MB

Unit test summary

********************
Testing Time: 4.09s
********************
Failing Tests (2):
    MLIR :: mlir-cpu-runner/linalg_integration_test.mlir
    MLIR :: mlir-cpu-runner/simple.mlir

  Expected Passes    : 253
  Unsupported Tests  : 4
  Unexpected Failures: 2
FAILED: projects/mlir/test/CMakeFiles/check-mlir 

Full unit test output

[951/952] Running the MLIR regression tests
FAIL: MLIR :: mlir-cpu-runner/simple.mlir (255 of 259)
******************** TEST 'MLIR :: mlir-cpu-runner/simple.mlir' FAILED ********************
Script:
--
: 'RUN: at line 1';   mlir-cpu-runner /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir
: 'RUN: at line 2';   mlir-cpu-runner -e foo -init-value 1000 /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir | /Users/ed/llvm-project/build/bin/FileCheck -check-prefix=NOMAIN /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir
: 'RUN: at line 3';   mlir-cpu-runner /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir -O3 | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir
: 'RUN: at line 4';   mlir-cpu-runner /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir -O3 -loop-distribute -loop-vectorize | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir
: 'RUN: at line 5';   mlir-cpu-runner /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir -loop-distribute -loop-vectorize | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir
--
Exit Code: 2

Command Output (stderr):
--
Program aborted due to an unhandled Error:
unsupported function typeStack dump:
0.  Program arguments: mlir-cpu-runner /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir 
0  mlir-cpu-runner          0x000000010c30226c llvm::sys::PrintStackTrace(llvm::raw_ostream&) + 60
1  mlir-cpu-runner          0x000000010c302829 PrintStackTraceSignalHandler(void*) + 25
2  mlir-cpu-runner          0x000000010c300506 llvm::sys::RunSignalHandlers() + 118
3  mlir-cpu-runner          0x000000010c3064f2 SignalHandler(int) + 210
4  libsystem_platform.dylib 0x00007fff61786b3d _sigtramp + 29
5  mlir-cpu-runner          0x000000010f1bb008 llvm::remarks::CurrentRemarkVersion + 12744
6  libsystem_c.dylib        0x00007fff616441c9 abort + 127
7  mlir-cpu-runner          0x000000010c1d4c30 llvm::Error::getPtr() const + 0
8  mlir-cpu-runner          0x000000010c1d5c77 llvm::Error::assertIsChecked() + 87
9  mlir-cpu-runner          0x000000010c1d5bd0 llvm::Error::operator=(llvm::Error&&) + 32
10 mlir-cpu-runner          0x000000010bd0a341 mlir::JitRunnerMain(int, char**, llvm::function_ref<mlir::LogicalResult (mlir::ModuleOp)>) + 1793
11 mlir-cpu-runner          0x000000010badbffb main + 75
12 libdyld.dylib            0x00007fff6159bed9 start + 1
13 libdyld.dylib            0x0000000000000002 start + 18446603338882892074
FileCheck error: '-' is empty.
FileCheck command line:  /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/simple.mlir

--

********************
FAIL: MLIR :: mlir-cpu-runner/linalg_integration_test.mlir (257 of 259)
******************** TEST 'MLIR :: mlir-cpu-runner/linalg_integration_test.mlir' FAILED ********************
Script:
--
: 'RUN: at line 1';   /Users/ed/llvm-project/build/bin/mlir-opt /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir -linalg-lower-to-llvm-dialect | mlir-cpu-runner -e dot -entry-point-result=f32 -shared-libs=/Users/ed/llvm-project/build/lib/libcblas.dylib,/Users/ed/llvm-project/build/lib/libcblas_interface.dylib | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir
: 'RUN: at line 2';   /Users/ed/llvm-project/build/bin/mlir-opt /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir -linalg-lower-to-loops -linalg-lower-to-llvm-dialect | mlir-cpu-runner -e dot -entry-point-result=f32 -shared-libs=/Users/ed/llvm-project/build/lib/libcblas.dylib,/Users/ed/llvm-project/build/lib/libcblas_interface.dylib | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir
: 'RUN: at line 3';   /Users/ed/llvm-project/build/bin/mlir-opt /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir -linalg-lower-to-llvm-dialect | mlir-cpu-runner -e matmul -entry-point-result=f32 -shared-libs=/Users/ed/llvm-project/build/lib/libcblas.dylib,/Users/ed/llvm-project/build/lib/libcblas_interface.dylib | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir
: 'RUN: at line 4';   /Users/ed/llvm-project/build/bin/mlir-opt /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir -linalg-lower-to-loops -linalg-lower-to-llvm-dialect | mlir-cpu-runner -e matmul -entry-point-result=f32 -shared-libs=/Users/ed/llvm-project/build/lib/libcblas.dylib,/Users/ed/llvm-project/build/lib/libcblas_interface.dylib | /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir
--
Exit Code: 2

Command Output (stderr):
--
Program aborted due to an unhandled Error:
unsupported function typeStack dump:
0.  Program arguments: mlir-cpu-runner -e dot -entry-point-result=f32 -shared-libs=/Users/ed/llvm-project/build/lib/libcblas.dylib,/Users/ed/llvm-project/build/lib/libcblas_interface.dylib 
0  mlir-cpu-runner          0x000000010111026c llvm::sys::PrintStackTrace(llvm::raw_ostream&) + 60
1  mlir-cpu-runner          0x0000000101110829 PrintStackTraceSignalHandler(void*) + 25
2  mlir-cpu-runner          0x000000010110e506 llvm::sys::RunSignalHandlers() + 118
3  mlir-cpu-runner          0x00000001011144f2 SignalHandler(int) + 210
4  libsystem_platform.dylib 0x00007fff61786b3d _sigtramp + 29
5  libsystem_platform.dylib 000000000000000000 _sigtramp + 18446603338880881888
6  libsystem_c.dylib        0x00007fff616441c9 abort + 127
7  mlir-cpu-runner          0x0000000100fe2c30 llvm::Error::getPtr() const + 0
8  mlir-cpu-runner          0x0000000100fe3c77 llvm::Error::assertIsChecked() + 87
9  mlir-cpu-runner          0x0000000100fe3bd0 llvm::Error::operator=(llvm::Error&&) + 32
10 mlir-cpu-runner          0x0000000100b18269 mlir::JitRunnerMain(int, char**, llvm::function_ref<mlir::LogicalResult (mlir::ModuleOp)>) + 1577
11 mlir-cpu-runner          0x00000001008e9ffb main + 75
12 libdyld.dylib            0x00007fff6159bed9 start + 1
FileCheck error: '-' is empty.
FileCheck command line:  /Users/ed/llvm-project/build/bin/FileCheck /Users/ed/llvm-project/llvm/projects/mlir/test/mlir-cpu-runner/linalg_integration_test.mlir
Johnson9009 commented 5 years ago

Meet the same two failed regression tests.

nicolasvasilache commented 5 years ago

fix is coming within minutes