ArmNN TFLite Delegate produces different output with CpuRef on x86_64 linux desktop

MrSherish commented 2 years ago

Hey,

As per my usecase:

I'm running ArmNN 22.05 built from scratch
TFLite 2.7 (C API, not C++ - but delegates leveraging C++ can be used)
x86_64 linux desktop (CpuRef) for the sake of initial implementation before moving to ARM-based platform

I have a running reference code with models in TFLite C library. For the past few days I was tinkering with ArmNN to offload most (if not all) operations to ArmNN Delegate. Finally after much work and reading source code (as documentation isn't helpful), I managed to run inference with one of the models running with delegate (without some operators, but some minor ones - there is a fallback to TFLite afaik in these cases). I had to use AllowExpandedDims option aswell for it to work.

The problem is: the produced output from the network is completely different and gibberish than the one in pure TFLite, rendering model unusable under ArmNN - at most I would expect some accuracy differences. If you do not know what the solution might be, what can I do to track down the rootcause? Some debugging tips? I also wonder if running under ARM would work.

I cannot share a model and I do not have a minimal example right now. Unsupported ops are (if it is helpful anyhow, but I guess it doesn't matter in that case):

ERROR: Operator STRIDED_SLICE [45] is not supported by armnn_delegate.
ERROR: Operator SIN [66] is not supported by armnn_delegate.
ERROR: Operator LOG [73] is not supported by armnn_delegate.
ERROR: Operator SQUARED_DIFFERENCE [99] is not supported by armnn_delegate.
ERROR: Operator COS [108] is not supported by armnn_delegate.

Code snippet which I use to add ArmNN delegate:

std::cout << "Initializing ArmNN\n";

std::vector<armnn::BackendId> backends;
backends.push_back("CpuRef");  // ARM magic not available on x86_64 desktop

// https://github.com/ARM-software/armnn/issues/653#issuecomment-1156832113
armnn::BackendOptions allow_expanded_dims("AllowExpandedDims",
                                          {{"AllowExpandedDims", true}});

std::vector<armnn::BackendOptions> backend_options{allow_expanded_dims};
armnn::OptimizerOptions optimizer_options;
optimizer_options.m_ModelOptions.push_back(allow_expanded_dims);
armnnDelegate::DelegateOptions armnn_options(backends, optimizer_options);

auto armnn_delegate = armnnDelegate::TfLiteArmnnDelegateCreate(armnn_options));
TfLiteInterpreterOptionsAddDelegate(options, armnn_delegate);

MrSherish commented 2 years ago

Today I've run ArmNN's Delegate unit tests to verify if my build is correct. Some of them are failing:

./DelegateUnitTests --test-suite='*CpuRef*'

[doctest] doctest version is "2.4.6"
[doctest] run with "--help" for options
INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
===============================================================================
ArmNN/delegate/src/test/PreluTest.cpp:50:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleConstTest_CpuRef_Test

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
===============================================================================
ArmNN/delegate/src/test/PreluTest.cpp:56:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleTest_CpuRef_Test

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
===============================================================================
ArmNN/delegate/src/test/PreluTest.cpp:62:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleConstDynamicTest_CpuRef_Test

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
===============================================================================
ArmNN/delegate/src/test/PreluTest.cpp:68:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleDynamicTest_CpuRef_Test

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

ArmNN/delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: Unsupported quantized data type: 3
ERROR: Node number 0 (REDUCE_PROD) failed to invoke.

===============================================================================
ArmNN/delegate/src/test/ReduceTest.cpp:357:
TEST SUITE: Prod_CpuRefTests
TEST CASE:  Prod_Uint8_KeepDims_CpuRef_Test

ArmNN/delegate/src/test/ReduceTestHelper.hpp:174: ERROR: CHECK( tfLiteInterpreter->Invoke() == kTfLiteOk ) is NOT correct!
  values: CHECK( 1 == 0 )

ArmNN/delegate/src/test/TestUtils.cpp:51: ERROR: CHECK( std::max(tensor1[i], tensor2[i]) - std::min(tensor1[i], tensor2[i]) <= tolerance ) is NOT correct!
  values: CHECK( 4 <= 1 )

ArmNN/delegate/src/test/TestUtils.cpp:51: ERROR: CHECK( std::max(tensor1[i], tensor2[i]) - std::min(tensor1[i], tensor2[i]) <= tolerance ) is NOT correct!
  values: CHECK( 186 <= 1 )

ArmNN/delegate/src/test/TestUtils.cpp:51: ERROR: CHECK( std::max(tensor1[i], tensor2[i]) - std::min(tensor1[i], tensor2[i]) <= tolerance ) is NOT correct!
  values: CHECK( 121 <= 1 )

ArmNN/delegate/src/test/TestUtils.cpp:51: ERROR: CHECK( std::max(tensor1[i], tensor2[i]) - std::min(tensor1[i], tensor2[i]) <= tolerance ) is NOT correct!
  values: CHECK( 4 <= 1 )

ArmNN/delegate/src/test/TestUtils.cpp:51: ERROR: CHECK( std::max(tensor1[i], tensor2[i]) - std::min(tensor1[i], tensor2[i]) <= tolerance ) is NOT correct!
  values: CHECK( 186 <= 1 )

ArmNN/delegate/src/test/TestUtils.cpp:51: ERROR: CHECK( std::max(tensor1[i], tensor2[i]) - std::min(tensor1[i], tensor2[i]) <= tolerance ) is NOT correct!
  values: CHECK( 121 <= 1 )

ERROR: Unsupported quantized data type: 1
ERROR: Node number 0 (REDUCE_PROD) failed to invoke.

===============================================================================
ArmNN/delegate/src/test/ReduceTest.cpp:366:
TEST SUITE: Prod_CpuRefTests
TEST CASE:  Prod_Fp32_CpuRef_Test

ArmNN/delegate/src/test/ReduceTestHelper.hpp:174: ERROR: CHECK( tfLiteInterpreter->Invoke() == kTfLiteOk ) is NOT correct!
  values: CHECK( 1 == 0 )

ArmNN/delegate/src/test/TestUtils.cpp:33: ERROR: CHECK( tensor1[i] == doctest::Approx( tensor2[i] ) ) is NOT correct!
  values: CHECK( 524.09399f == Approx( 10010.0 ) )

ArmNN/delegate/src/test/TestUtils.cpp:33: ERROR: CHECK( tensor1[i] == doctest::Approx( tensor2[i] ) ) is NOT correct!
  values: CHECK( 1013.0f == Approx( 11022.0 ) )

ArmNN/delegate/src/test/TestUtils.cpp:33: ERROR: CHECK( tensor1[i] == doctest::Approx( tensor2[i] ) ) is NOT correct!
  values: CHECK( 1015.0f == Approx( 12036.0 ) )

ArmNN/delegate/src/test/TestUtils.cpp:33: ERROR: CHECK( tensor1[i] == doctest::Approx( tensor2[i] ) ) is NOT correct!
  values: CHECK( 524.09399f == Approx( 10010.0 ) )

ArmNN/delegate/src/test/TestUtils.cpp:33: ERROR: CHECK( tensor1[i] == doctest::Approx( tensor2[i] ) ) is NOT correct!
  values: CHECK( 1013.0f == Approx( 11022.0 ) )

ArmNN/delegate/src/test/TestUtils.cpp:33: ERROR: CHECK( tensor1[i] == doctest::Approx( tensor2[i] ) ) is NOT correct!
  values: CHECK( 1015.0f == Approx( 12036.0 ) )

ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
ERROR: Operator DELEGATE [51] is not supported by armnn_delegate.
===============================================================================
[doctest] test cases:   232 |   226 passed |  6 failed | 403 skipped
[doctest] assertions: 18802 | 18764 passed | 38 failed |
[doctest] Status: FAILURE!

MikeJKelly commented 2 years ago

Hi @MrSherish

These errors seemed to be related to the TFLite version I see them in 2.7 but not in version 2.5 which is the version we test with. I'll see if I can find out the defect but if you can switch to 2.5 it might solve your issues?

Best regards, Mike

MrSherish commented 2 years ago

I'll check at the beginning of next week if:

the issue persists with 2.7 and CpuAcc on ARM
switching to 2.5 indeed solves it for my model

I would like to stay on 2.7 anyway, because of availability of signature API since that version. https://www.tensorflow.org/lite/guide/signatures

I think that in the end the issue should be fixed regardless. Tensorflow itself is already at version 2.9.

MrSherish commented 2 years ago

Interesting: using still TFLite 2.7, armv7 Android, CpuAcc gets confused about StridedSlice:

ERROR: Operator SIN [66] is not supported by armnn_delegate.
ERROR: Operator LOG [73] is not supported by armnn_delegate.
ERROR: Operator SQUARED_DIFFERENCE [99] is not supported by armnn_delegate.
ERROR: Operator COS [108] is not supported by armnn_delegate.
INFO: Replacing 121 node(s) with delegate (TfLiteArmNnDelegate) node, yielding 19 partitions.
terminating with uncaught exception of type armnn::Exception: TfLiteArmnnDelegate: Exception (TfLiteArmnnDelegate: Network could not be loaded:An error occurred when preparing the network workloads:  StridedSliceQueueDescriptor:  Tensor type is not supported.) caught from LoadNetwork.
/buildbot/src/android/ndk-release-r21/external/libcxx/../../external/libcxxabi/src/abort_message.cpp:72: abort_message: assertion "terminating with uncaught exception of type armnn::Exception: TfLiteArmnnDelegate: Exception (TfLiteArmnnDelegate: Network could not be loaded:An error occurred when preparing the network workloads:  StridedSliceQueueDescriptor:  Tensor type is not supported.) caught from LoadNetwork." failed

Above didn't happen on desktop with CpuRef:

ERROR: Operator STRIDED_SLICE [45] is not supported by armnn_delegate.

But I guess (based on documentation and code) that StridedSlice should be still well supported by ArmNN delegate

james-conroy-arm commented 2 years ago

Hi @MrSherish ,

Would you mind testing with TF Lite 2.5 please, to eliminate the version you are using as the root cause of the issue?

Thanks, James

MrSherish commented 2 years ago

Results from x86_64 desktop CpuRef and TFLite 2.5:

output from my neural network is still gibberish
there are many many more tests failing, but for different reason (immutable graph):

./src/delegate/DelegateUnitTests --test-suite='*CpuRef*'                                                                                                                                  13:09:05
[doctest] doctest version is "2.4.6"
[doctest] run with "--help" for options
INFO: Created TensorFlow Lite XNNPACK delegate for CPU.
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ActivationTest.cpp:179:
TEST SUITE: Activation_CpuRefTests
TEST CASE:  Activation_ReLu_CpuRef_Test

delegate/src/test/ActivationTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ActivationTest.cpp:185:
TEST SUITE: Activation_CpuRefTests
TEST CASE:  Activation_Bounded_Relu6_CpuRef_Test

delegate/src/test/ActivationTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ActivationTest.cpp:191:
TEST SUITE: Activation_CpuRefTests
TEST CASE:  Activation_Sigmoid_CpuRef_Test

delegate/src/test/ActivationTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ActivationTest.cpp:197:
TEST SUITE: Activation_CpuRefTests
TEST CASE:  Activation_TanH_CpuRef_Test

delegate/src/test/ActivationTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ActivationTest.cpp:203:
TEST SUITE: Activation_CpuRefTests
TEST CASE:  Activation_Elu_CpuRef_Test

delegate/src/test/ActivationTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ActivationTest.cpp:209:
TEST SUITE: Activation_CpuRefTests
TEST CASE:  Activation_HardSwish_CpuRef_Test

delegate/src/test/ActivationTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ArgMinMaxTest.cpp:108:
TEST SUITE: ArgMinMax_CpuRefTests
TEST CASE:  ArgMaxFP32Test_CpuRef_Test

delegate/src/test/ArgMinMaxTestHelper.hpp:174: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ArgMinMaxTest.cpp:114:
TEST SUITE: ArgMinMax_CpuRefTests
TEST CASE:  ArgMinFP32Test_CpuRef_Test

delegate/src/test/ArgMinMaxTestHelper.hpp:174: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/BatchSpaceTest.cpp:209:
TEST SUITE: BatchToSpaceND_CpuRefTests
TEST CASE:  BatchToSpaceND_Fp32_CpuRef_Test

delegate/src/test/BatchSpaceTestHelper.hpp:196: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/BatchSpaceTest.cpp:215:
TEST SUITE: BatchToSpaceND_CpuRefTests
TEST CASE:  BatchToSpaceND_Fp32_BatchOne_CpuRef_Test

delegate/src/test/BatchSpaceTestHelper.hpp:196: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/BatchSpaceTest.cpp:279:
TEST SUITE: SpaceToBatchND_CpuRefTests
TEST CASE:  SpaceToBatchND_Fp32_CpuRef_Test

delegate/src/test/BatchSpaceTestHelper.hpp:196: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/BatchSpaceTest.cpp:285:
TEST SUITE: SpaceToBatchND_CpuRefTests
TEST CASE:  SpaceToBatchND_Fp32_Padding_CpuRef_Test

delegate/src/test/BatchSpaceTestHelper.hpp:196: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/CastTest.cpp:58:
TEST SUITE: CAST_CpuRefTests
TEST CASE:  CAST_UINT8_TO_FP32_CpuRef_Test

delegate/src/test/CastTestHelper.hpp:136: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/CastTest.cpp:64:
TEST SUITE: CAST_CpuRefTests
TEST CASE:  CAST_INT32_TO_FP32_CpuRef_Test

delegate/src/test/CastTestHelper.hpp:136: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:503:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  EQUAL_FP32_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:509:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  EQUAL_Broadcast_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:521:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  NOT_EQUAL_FP32_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:527:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  NOT_EQUAL_Broadcast_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:539:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  GREATER_FP32_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:545:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  GREATER_Broadcast_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:557:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  GREATER_EQUAL_FP32_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:563:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  GREATER_EQUAL_Broadcast_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:575:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  LESS_FP32_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:581:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  LESS_Broadcast_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:593:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  LESS_EQUAL_FP32_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ComparisonTest.cpp:599:
TEST SUITE: Comparison_CpuRefTests
TEST CASE:  LESS_EQUAL_Broadcast_CpuRef_Test

delegate/src/test/ComparisonTestHelper.hpp:190: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ControlTest.cpp:312:
TEST SUITE: Concatenation_CpuRefTests
TEST CASE:  Concatenation_Float32_CpuRef_Test

delegate/src/test/ControlTestHelper.hpp:253: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ControlTest.cpp:406:
TEST SUITE: Mean_CpuRefTests
TEST CASE:  Mean_Fp32_KeepDims_CpuRef_Test

delegate/src/test/ControlTestHelper.hpp:325: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ControlTest.cpp:412:
TEST SUITE: Mean_CpuRefTests
TEST CASE:  Mean_Fp32_CpuRef_Test

delegate/src/test/ControlTestHelper.hpp:325: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Convolution2dTest.cpp:305:
TEST SUITE: Convolution2dTest_CpuRefTests
TEST CASE:  Conv2DWithBiases_Fp32_CpuRef_Test

delegate/src/test/ConvolutionTestHelper.hpp:274: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Convolution2dTest.cpp:441:
TEST SUITE: TransposeConv_CpuRef_Test
TEST CASE:  TransposeConv_Fp32_Test

delegate/src/test/ConvolutionTestHelper.hpp:745: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/DepthwiseConvolution2dTest.cpp:228:
TEST SUITE: DepthwiseConv2d_CpuRef_Tests
TEST CASE:  DepthwiseConv2d_Valid_Relu_Fp32_CpuRef_Test

delegate/src/test/ConvolutionTestHelper.hpp:274: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1002:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  ADD_FP32_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1008:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  ADD_Broadcast_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1014:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  ADD_Constant_Input_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1020:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  ADD_Actiation_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1032:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  DIV_FP32_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1038:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  DIV_Broadcast_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1044:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  FLOORDIV_FP32_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1056:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  MAX_FP32_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1062:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  MAX_Broadcast_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1074:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  MIN_FP32_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1080:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  MIN_Broadcast_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1092:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  MUL_FP32_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1098:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  MUL_Broadcast_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1104:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  MUL_Actiation_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1116:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  SUB_FP32_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseBinaryTest.cpp:1122:
TEST SUITE: ElementwiseBinary_CpuRefTests
TEST CASE:  SUB_Broadcast_CpuRef_Test

delegate/src/test/ElementwiseBinaryTestHelper.hpp:220: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseUnaryTest.cpp:200:
TEST SUITE: ElementwiseUnary_CpuRefTests
TEST CASE:  Abs_Float32_CpuRef_Test

delegate/src/test/ElementwiseUnaryTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseUnaryTest.cpp:220:
TEST SUITE: ElementwiseUnary_CpuRefTests
TEST CASE:  Exp_Float32_CpuRef_Test

delegate/src/test/ElementwiseUnaryTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseUnaryTest.cpp:242:
TEST SUITE: ElementwiseUnary_CpuRefTests
TEST CASE:  Neg_Float32_CpuRef_Test

delegate/src/test/ElementwiseUnaryTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseUnaryTest.cpp:262:
TEST SUITE: ElementwiseUnary_CpuRefTests
TEST CASE:  Rsqrt_Float32_CpuRef_Test

delegate/src/test/ElementwiseUnaryTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ElementwiseUnaryTest.cpp:282:
TEST SUITE: ElementwiseUnary_CpuRefTests
TEST CASE:  Sqrt_Float32_CpuRef_Test

delegate/src/test/ElementwiseUnaryTestHelper.hpp:110: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FillTest.cpp:119:
TEST SUITE: Fill_CpuRefTests
TEST CASE:  Fill2d_CpuRef_Test

delegate/src/test/FillTestHelper.hpp:151: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FillTest.cpp:125:
TEST SUITE: Fill_CpuRefTests
TEST CASE:  Fill3d_CpuRef_Test

delegate/src/test/FillTestHelper.hpp:151: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FillTest.cpp:131:
TEST SUITE: Fill_CpuRefTests
TEST CASE:  Fill3d_CpuRef_Test

delegate/src/test/FillTestHelper.hpp:151: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FillTest.cpp:137:
TEST SUITE: Fill_CpuRefTests
TEST CASE:  Fill4d_CpuRef_Test

delegate/src/test/FillTestHelper.hpp:151: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FullyConnectedTest.cpp:140:
TEST SUITE: FullyConnected_CpuRefTests
TEST CASE:  FullyConnected_FP32_CpuRef_Test

delegate/src/test/FullyConnectedTestHelper.hpp:216: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FullyConnectedTest.cpp:152:
TEST SUITE: FullyConnected_CpuRefTests
TEST CASE:  FullyConnected_Activation_CpuRef_Test

delegate/src/test/FullyConnectedTestHelper.hpp:216: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FullyConnectedTest.cpp:158:
TEST SUITE: FullyConnected_CpuRefTests
TEST CASE:  FullyConnected_Weights_As_Inputs_FP32_CpuRef_Test

delegate/src/test/FullyConnectedTestHelper.hpp:216: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/FullyConnectedTest.cpp:170:
TEST SUITE: FullyConnected_CpuRefTests
TEST CASE:  FullyConnected_Weights_As_Inputs_Activation_CpuRef_Test

delegate/src/test/FullyConnectedTestHelper.hpp:216: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/GatherNdTest.cpp:70:
TEST SUITE: GATHER_ND_CpuRefTests
TEST CASE:  GATHER_ND_Fp32_CpuRef_Test

delegate/src/test/GatherNdTestHelper.hpp:156: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/GatherTest.cpp:74:
TEST SUITE: GATHER_CpuRefTests
TEST CASE:  GATHER_Fp32_CpuRef_Test

delegate/src/test/GatherTestHelper.hpp:159: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/LstmTest.cpp:170:
TEST SUITE: LstmTest_CpuRefTests
TEST CASE:  LstmTest_CpuRef_Test

delegate/src/test/LstmTestHelper.hpp:659: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/MirrorPadTest.cpp:303:
TEST SUITE: MirrorPad_CpuRefTests
TEST CASE:  MirrorPadSymmetric2d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/MirrorPadTest.cpp:309:
TEST SUITE: MirrorPad_CpuRefTests
TEST CASE:  MirrorPadReflect2d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/MirrorPadTest.cpp:315:
TEST SUITE: MirrorPad_CpuRefTests
TEST CASE:  MirrorPadSymmetric3d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/MirrorPadTest.cpp:321:
TEST SUITE: MirrorPad_CpuRefTests
TEST CASE:  MirrorPadReflect3d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/NormalizationTest.cpp:20:
TEST SUITE: L2Normalization_CpuRefTests
TEST CASE:  L2NormalizationFp32Test_CpuRef_Test

delegate/src/test/NormalizationTestHelper.hpp:167: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/NormalizationTest.cpp:42:
TEST SUITE: LocalResponseNormalization_CpuRefTests
TEST CASE:  LocalResponseNormalizationTest_CpuRef_Test

delegate/src/test/NormalizationTestHelper.hpp:167: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PackTest.cpp:458:
TEST SUITE: Pack_CpuRefTests
TEST CASE:  Pack_Fp32_Axis0_CpuRef_Test

delegate/src/test/PackTestHelper.hpp:161: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PackTest.cpp:464:
TEST SUITE: Pack_CpuRefTests
TEST CASE:  Pack_Fp32_Axis1_CpuRef_Test

delegate/src/test/PackTestHelper.hpp:161: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PackTest.cpp:470:
TEST SUITE: Pack_CpuRefTests
TEST CASE:  Pack_Fp32_Axis2_CpuRef_Test

delegate/src/test/PackTestHelper.hpp:161: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PackTest.cpp:476:
TEST SUITE: Pack_CpuRefTests
TEST CASE:  Pack_Fp32_Axis3_CpuRef_Test

delegate/src/test/PackTestHelper.hpp:161: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PackTest.cpp:482:
TEST SUITE: Pack_CpuRefTests
TEST CASE:  Pack_Fp32_Inputs3_CpuRef_Test

delegate/src/test/PackTestHelper.hpp:161: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PadTest.cpp:414:
TEST SUITE: Pad_CpuRefTests
TEST CASE:  Pad2d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PadTest.cpp:420:
TEST SUITE: Pad_CpuRefTests
TEST CASE:  Pad3d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PadTest.cpp:426:
TEST SUITE: Pad_CpuRefTests
TEST CASE:  Pad4d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PadTest.cpp:444:
TEST SUITE: Pad_CpuRefTests
TEST CASE:  PadV22d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PadTest.cpp:450:
TEST SUITE: Pad_CpuRefTests
TEST CASE:  PadV23d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PadTest.cpp:456:
TEST SUITE: Pad_CpuRefTests
TEST CASE:  PadV24d_CpuRef_Test

delegate/src/test/PadTestHelper.hpp:211: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1105:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  MaxPooling2d_FP32_PaddingValid_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1117:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  MaxPooling2d_FP32_PaddingSame_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1129:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  MaxPooling2d_FP32_Relu_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1141:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  MaxPooling2d_FP32_Relu6_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1177:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  AveragePooling2d_FP32_PaddingValid_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1189:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  AveragePooling2d_FP32_PaddingSame_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1201:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  AveragePooling2d_FP32_Relu_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1207:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  AveragePooling2d_FP32_Relu6_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1249:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  L2Pooling2d_FP32_PaddingValid_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1255:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  L2Pooling2d_FP32_PaddingSame_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1261:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  L2Pooling2d_FP32_Relu_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/Pooling2dTest.cpp:1267:
TEST SUITE: Pooling2d_CpuRefTests
TEST CASE:  L2Pooling2d_FP32_Relu6_CpuRef_Test

delegate/src/test/Pooling2dTestHelper.hpp:168: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PreluTest.cpp:50:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleConstTest_CpuRef_Test

delegate/src/test/PreluTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PreluTest.cpp:56:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleTest_CpuRef_Test

delegate/src/test/PreluTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PreluTest.cpp:62:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleConstDynamicTest_CpuRef_Test

delegate/src/test/PreluTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/PreluTest.cpp:68:
TEST SUITE: Prelu_CpuRefTests
TEST CASE:  PreluFp32SimpleDynamicTest_CpuRef_Test

delegate/src/test/PreluTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 0.0f == 3.0f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 3.0f == 0.0f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( -2.5f == 9.82344f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.82344f == -2.5f )

delegate/src/test/PreluTestHelper.hpp:188: ERROR: CHECK( expectedOutput[i] == armnnDelegateOutputData[i] ) is NOT correct!
  values: CHECK( 14.0f == 9.3675f )

delegate/src/test/PreluTestHelper.hpp:189: ERROR: CHECK( tfLiteDelegateOutputData[i] == expectedOutput[i] ) is NOT correct!
  values: CHECK( 9.3675f == 14.0f )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/QuantizationTest.cpp:285:
TEST SUITE: CpuRef_QuantizationTests
TEST CASE:  DEQUANTIZE_UINT8_CpuRef_Test

delegate/src/test/QuantizationTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/QuantizationTest.cpp:292:
TEST SUITE: CpuRef_QuantizationTests
TEST CASE:  DEQUANTIZE_INT8_CpuRef_Test

delegate/src/test/QuantizationTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/QuantizationTest.cpp:299:
TEST SUITE: CpuRef_QuantizationTests
TEST CASE:  DEQUANTIZE_INT16_CpuRef_Test

delegate/src/test/QuantizationTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/QuantizationTest.cpp:306:
TEST SUITE: CpuRef_QuantizationTests
TEST CASE:  QUANTIZE_FLOAT32_UINT8_CpuRef_Test

delegate/src/test/QuantizationTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/QuantizationTest.cpp:313:
TEST SUITE: CpuRef_QuantizationTests
TEST CASE:  QUANTIZE_FLOAT32_INT8_CpuRef_Test

delegate/src/test/QuantizationTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/QuantizationTest.cpp:320:
TEST SUITE: CpuRef_QuantizationTests
TEST CASE:  QUANTIZE_FLOAT32_INT16_CpuRef_Test

delegate/src/test/QuantizationTestHelper.hpp:162: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReduceTest.cpp:136:
TEST SUITE: ReduceMax_CpuRefTests
TEST CASE:  ReduceMax_Fp32_KeepDims_CpuRef_Test

delegate/src/test/ReduceTestHelper.hpp:167: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReduceTest.cpp:145:
TEST SUITE: ReduceMax_CpuRefTests
TEST CASE:  ReduceMax_Fp32_CpuRef_Test

delegate/src/test/ReduceTestHelper.hpp:167: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReduceTest.cpp:244:
TEST SUITE: ReduceMin_CpuRefTests
TEST CASE:  ReduceMin_Fp32_CpuRef_Test

delegate/src/test/ReduceTestHelper.hpp:167: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReduceTest.cpp:296:
TEST SUITE: Sum_CpuRefTests
TEST CASE:  Sum_Fp32_CpuRef_Test

delegate/src/test/ReduceTestHelper.hpp:167: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReduceTest.cpp:366:
TEST SUITE: Prod_CpuRefTests
TEST CASE:  Prod_Fp32_CpuRef_Test

delegate/src/test/ReduceTestHelper.hpp:167: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:419:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_Simple_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:425:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_ReduceDimension_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:431:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_Flatten_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:437:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_FlattenAll_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:467:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_Simple_ShapeTensor_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:473:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_ReduceDimension_ShapeTensor_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:479:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_Flatten_ShapeTensor_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ReshapeTest.cpp:485:
TEST SUITE: Reshape_CpuRefTests
TEST CASE:  Reshape_FlattenAll_ShapeTensor_CpuRef_Test

delegate/src/test/RedefineTestHelper.hpp:179: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ResizeTest.cpp:120:
TEST SUITE: ResizeTests_CpuRefTests
TEST CASE:  Resize_Biliniar_Float32_CpuRef_Test

delegate/src/test/ResizeTestHelper.hpp:164: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/ResizeTest.cpp:126:
TEST SUITE: ResizeTests_CpuRefTests
TEST CASE:  Resize_NearestNeighbour_Float32_CpuRef_Test

delegate/src/test/ResizeTestHelper.hpp:164: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/RoundTest.cpp:41:
TEST SUITE: FLOOR_CpuRefTests
TEST CASE:  FLOOR_Fp32_CpuRef_Test

delegate/src/test/RoundTestHelper.hpp:140: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SliceTest.cpp:155:
TEST SUITE: StridedSlice_CpuRefTests
TEST CASE:  StridedSlice_4D_CpuRef_Test

delegate/src/test/SliceTestHelper.hpp:221: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SliceTest.cpp:161:
TEST SUITE: StridedSlice_CpuRefTests
TEST CASE:  StridedSlice_4D_Reverse_CpuRef_Test

delegate/src/test/SliceTestHelper.hpp:221: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SliceTest.cpp:167:
TEST SUITE: StridedSlice_CpuRefTests
TEST CASE:  StridedSlice_SimpleStride_CpuRef_Test

delegate/src/test/SliceTestHelper.hpp:221: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SliceTest.cpp:173:
TEST SUITE: StridedSlice_CpuRefTests
TEST CASE:  StridedSlice_SimpleRange_CpuRef_Test

delegate/src/test/SliceTestHelper.hpp:221: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SoftmaxTest.cpp:50:
TEST SUITE: Softmax_CpuRefTests
TEST CASE:  Softmax_Standard_Beta_CpuRef_Test

delegate/src/test/SoftmaxTestHelper.hpp:136: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SoftmaxTest.cpp:59:
TEST SUITE: Softmax_CpuRefTests
TEST CASE:  Softmax_Different_Beta_CpuRef_Test

delegate/src/test/SoftmaxTestHelper.hpp:136: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SoftmaxTest.cpp:68:
TEST SUITE: Softmax_CpuRefTests
TEST CASE:  Log_Softmax_CpuRef_Test

delegate/src/test/SoftmaxTestHelper.hpp:136: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SpaceDepthTest.cpp:107:
TEST SUITE: DepthToSpace_CpuRefTests
TEST CASE:  DepthToSpaceFp32Test_CpuRef_Test

delegate/src/test/SpaceDepthTestHelper.hpp:152: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SpaceDepthTest.cpp:159:
TEST SUITE: SpaceToDepth_CpuRefTests
TEST CASE:  SpaceToDepthFp32Test_CpuRef_Test

delegate/src/test/SpaceDepthTestHelper.hpp:152: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SplitTest.cpp:89:
TEST SUITE: SPLIT_CpuRefTests
TEST CASE:  SPLIT_Fp32_CpuRef_Test

delegate/src/test/SplitTestHelper.hpp:165: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/SplitTest.cpp:219:
TEST SUITE: SPLIT_V_CpuRefTests
TEST CASE:  SPLIT_V_Fp32_CpuRef_Test

delegate/src/test/SplitTestHelper.hpp:344: ERROR: CHECK( armnnDelegate->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/TransposeTest.cpp:40:
TEST SUITE: Transpose_CpuRefTests
TEST CASE:  Transpose_Float32_CpuRef_Test

delegate/src/test/TransposeTestHelper.hpp:124: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1402:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1408:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmTimeMajorTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1414:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmNoCifgWithPeepholeWithProjectionTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1420:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmWithCifgWithPeepholeNoProjectionTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1426:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmNoCifgWithPeepholeWithProjectionWithLayerNormTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1432:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmInt8Test_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1438:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmTimeInt8TimeMajorTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1444:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmInt8NoCifgWithPeepholeWithProjectionTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1450:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmInt8WithCifgWithPeepholeNoProjectionTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnidirectionalSequenceLstmTest.cpp:1456:
TEST SUITE: UnidirectionalSequenceLstmTest_CpuRefTests
TEST CASE:  UnidirectionalSequenceLstmInt8NoCifgWithPeepholeWithProjectionWithLayerNormTest_CpuRef_Test

delegate/src/test/UnidirectionalSequenceLstmTestHelper.hpp:677: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnpackTest.cpp:88:
TEST SUITE: Unpack_CpuRefTests
TEST CASE:  Unpack_Fp32_Axis0_Num4_CpuRef_Test

delegate/src/test/UnpackTestHelper.hpp:161: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

ERROR: ModifyGraphWithDelegate is disallowed when graph is immutable.
===============================================================================
delegate/src/test/UnpackTest.cpp:94:
TEST SUITE: Unpack_CpuRefTests
TEST CASE:  Unpack_Fp32_Axis2_Num6_CpuRef_Test

delegate/src/test/UnpackTestHelper.hpp:161: ERROR: CHECK( armnnDelegateInterpreter->ModifyGraphWithDelegate(theArmnnDelegate.get()) == kTfLiteOk ) is NOT correct!
  values: CHECK( 3 == 0 )

===============================================================================
[doctest] test cases:   228 |    85 passed | 143 failed | 397 skipped
[doctest] assertions: 18615 | 18448 passed | 167 failed |
[doctest] Status: FAILURE!

MrSherish commented 2 years ago

Interesting: using still TFLite 2.7, armv7 Android, CpuAcc gets confused about StridedSlice:

I moved StridedSlice issue on arm to https://github.com/ARM-software/armnn/issues/663, as it's not related

ARM-software / armnn

ArmNN TFLite Delegate produces different output with CpuRef on x86_64 linux desktop #656