Tarpaulin ignoring #[cfg(not(tarpaulin))] on integration test

[ninehusky]

Describe the bug There are a number of integration tests that @gussmith23 and I don't want to run when executing Tarpaulin. One such test in our repo is found in the add-code-coverage branch, specifically tests/generate-mlp-allocate-for-manycore.rs. In this file, I have the following attribute:

#![cfg(not(tarpaulin_include))]

However, when running Tarpaulin we still see that the tests run (and therefore the test suite fails):

Jan 29 06:08:01.056  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 06:08:01.057  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/generate_mlp_allocate_for_manycore-4ca8c5d7bd5a28e9

running 1 test
test asplos_demo_generate_mlp_allocate_for_manycore ... FAILED

failures:

---- asplos_demo_generate_mlp_allocate_for_manycore stdout ----
thread 'asplos_demo_generate_mlp_allocate_for_manycore' panicked at 'called `Result::unwrap()` on an `Err` value: Os { code: 2, kind: NotFound, message: "No such file or directory" }', tests/generate-mlp-allocate-for-manycore.rs:43:6
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

Could this be an issue with the --no-default-features --features tvm arguments that we supply to the Tarpaulin command below?

To Reproduce

git clone https://github.com/gussmith23/glenside.git
cd glenside
git checkout add-code-coverage
docker build --tag glenside .
docker run --privileged glenside /bin/bash -c "cargo install cargo-tarpaulin && cargo tarpaulin --no-default-features --features tvm"

Expected behavior Each of the 4 tests with the above directive are not run during the execution of the above commands.

[xd009642]

Okay so the issue title mentions #[cfg(not(tarpaulin))] but the body mentions #![cfg(not(tarpaulin_include))]. These are different attributes, the first impacts what code is compiled into the binary, and the latter changes what code tarpaulin includes in results but doesn't affect the code compiled. So if you're using #![cfg(not(tarpaulin_include))] the tests will still be present. Instead you should use #![cfg(not(tarpaulin))]

[ninehusky]

Sorry, I meant #![cfg(not(tarpaulin))] - forgot to push some changes! We get the same output with the updated attributes.

[xd009642]

So I ran the steps to reproduce and wasn't able to, the tests in question weren't ran with the latest changes you pushed. Only slight change was I ran cargo tarpaulin --color off --no-default-features --features tvm to remove the ANSI colour codes from the logs I grabbed

This was the output:

Jan 29 16:18:49.395  INFO cargo_tarpaulin::config: Creating config
Jan 29 16:18:49.590  INFO cargo_tarpaulin: Running Tarpaulin
Jan 29 16:18:49.590  INFO cargo_tarpaulin: Building project
Jan 29 16:18:49.590  INFO cargo_tarpaulin::cargo: Cleaning project
Jan 29 16:21:08.498  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:08.510  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/tensorize_conv2d_with_padding_and_splitting_with_blocking_from_command_line-a00456889b3c2350

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

Jan 29 16:21:08.718  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:08.718  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/asplos_demo-3004d07d93891af2

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

Jan 29 16:21:08.942  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:08.942  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/codegen_mlp-d03581f590d7db78

running 1 test
test codegen_mlp ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.27s

Jan 29 16:21:11.482  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:11.482  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/tensorize_conv2d_with_padding_and_splitting_from_command_line-60c2ae459efbf865

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

Jan 29 16:21:11.718  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:11.718  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/resnet18_relay_to_glenside-4f8d846d1f71baa5

running 1 test
test resnet18_relay_to_glenside ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.77s

Jan 29 16:21:15.166  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:15.166  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/regular_small_multilayer_perceptron-1e3dc38e7ed7218e

running 1 test
test regular_small_multilayer_perceptron ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 8.48s

Jan 29 16:21:26.007  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:26.007  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/generate_mlp_allocate_for_manycore-4ca8c5d7bd5a28e9

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

Jan 29 16:21:26.262  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:26.262  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/mobilenet_try_to_run_rewrites-13fa1fa70a15a0ad

running 1 test
test mobilenet_try_to_run_rewrites - should panic ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 13.60s

Jan 29 16:21:42.291  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:42.291  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/tensorize_conv2d_with_padding_and_splitting-ef7a4737d76ceb76

running 0 tests

test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s

Jan 29 16:21:42.518  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:42.518  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/regular_multilayer_perceptron-328c649f7dbc8051

running 1 test
test regular_multilayer_perceptron ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.47s

Jan 29 16:21:45.774  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:45.774  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/run_glenside_examples-ab446c04ae725dfc

running 1 test
test run_glenside_examples ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.91s

Jan 29 16:21:51.630  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:51.630  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/interpret_conv2d-4b1dac087002908f

running 1 test
test interpret_conv2d ... ok

test result: ok. 1 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 2.75s

Jan 29 16:21:57.279  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:21:57.279  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/mobilenet_relay_to_glenside-9bc10309a6675b70

running 2 tests
test parse_mobilenet ... ok
test parse_mobilenet_simplified_for_inference ... ok

test result: ok. 2 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 3.21s

Jan 29 16:22:02.887  INFO cargo_tarpaulin::process_handling::linux: Launching test
Jan 29 16:22:02.887  INFO cargo_tarpaulin::process_handling: running /root/glenside/target/debug/deps/glenside-cb262be1a8a15b3c

running 311 tests
test codegen::tests::relay_model_efficientnet_lite4_11 ... ignored
test codegen::tests::relay_model_yolov3 ... ignored
test codegen::tests::relay_op_avgpool2d ... ignored
test codegen::tests::extract_monolithic_panic - should panic ... ok
test codegen::tests::concat ... ok
test codegen::tests::relay_op_biasadd ... ok
test codegen::tests::relay_op_add ... ok
test codegen::tests::relay_op_leakyrelu ... ignored
test codegen::tests::relay_op_maximum ... ignored
test codegen::tests::relay_op_minimum ... ignored
test codegen::tests::access_flatten ... ok
test codegen::tests::relay_op_sigmoid ... ignored
test codegen::tests::pad ... ok
test codegen::tests::relay_op_upsampling ... ignored
test codegen::tests::relay_op_batchflatten ... ok
test codegen::tests::relay_op_batchnorm ... ok
test codegen::tests::systolic_array ... ok
test codegen::tests::systolic_array_with_blocking ... ok
test extraction::tests::extract_0 ... ok
test extraction::tests::extract_1 ... ok
test extraction::tests::find_systolic_array_configs_0 ... ok
test extraction::tests::find_systolic_array_configs_1 ... ok
test extraction::tests::simple_cost_function_0 ... ok
test hw_design_language::tests::serialize ... ok
test codegen::tests::relay_op_relu ... ok
test codegen::tests::relay_op_globalavgpool2d ... ok
test codegen::tests::relay_op_softmax ... ok
test codegen::tests::transpose ... ok
test codegen::tests::access_windows ... ok
test codegen::tests::slice ... ok
test language::from_relay::tests::batch_flatten ... ok
test language::from_relay::tests::add ... ok
test language::from_relay::tests::bias_add_axis_0 ... ok
test language::from_relay::tests::bias_add_axis_1 ... ok
test language::from_relay::tests::bias_add_axis_neg_1 ... ok
test language::from_relay::tests::bias_add_axis_neg_2 ... ok
test language::from_relay::tests::concatenate ... ok
test language::from_relay::tests::constant_0 ... ok
test language::from_relay::tests::divide ... ok
test language::from_relay::tests::expand_dims ... ok
test language::from_relay::tests::dense ... ok
test codegen::tests::relay_op_maxpool2d_resnet_3x3 has been running for over 60 seconds
test language::from_relay::tests::conv2d_nhwc_hwio ... ok
test language::from_relay::tests::conv2d_depthwise_separable_stage1 ... ok
test language::from_relay::tests::conv2d ... ok
test language::from_relay::tests::global_avg_pool2d ... ok
test language::from_relay::tests::max_pool2d ... ok
test language::from_relay::tests::negative ... ok
test language::from_relay::tests::relu ... ok
test language::interpreter::tests::access ... ok
test language::interpreter::tests::access_broadcast ... ok
test language::interpreter::tests::access_broadcast_panic - should panic ... ok
test language::from_relay::tests::multiply ... ok
test language::interpreter::tests::access_cartesian_product ... ok
test language::interpreter::tests::access_concatenate_0 ... ok
test language::interpreter::tests::access_concatenate_1 ... ok
test language::interpreter::tests::access_concatenate_panic_1 - should panic ... ok
test language::interpreter::tests::access_concatenate_panic_0 - should panic ... ok
test language::interpreter::tests::access_flatten_0 ... ok
test language::interpreter::tests::access_flatten_1 ... ok
test language::interpreter::tests::access_flatten_3 ... ok
test language::interpreter::tests::access_flatten_2 ... ok
test language::interpreter::tests::access_insert_axis_1 ... ok
test language::interpreter::tests::access_insert_axis_0 ... ok
test language::interpreter::tests::access_literal ... ok
test language::interpreter::tests::access_pad_min_padding ... ok
test language::interpreter::tests::access_pad ... ok
test language::interpreter::tests::access_pair_1 ... ok
test language::interpreter::tests::access_pair_0 ... ok
test language::interpreter::tests::access_pair_panic - should panic ... ok
test language::interpreter::tests::access_pair_2 ... ok
test language::interpreter::tests::access_panic - should panic ... ok
test language::interpreter::tests::access_shape ... ok
test language::interpreter::tests::access_slice_1 ... ok
test language::interpreter::tests::access_slice_0 ... ok
test language::interpreter::tests::access_slice_panic_0 - should panic ... ok
test language::interpreter::tests::access_slice_2 ... ok
test language::interpreter::tests::access_slice_panic_1 - should panic ... ok
test language::interpreter::tests::access_squeeze_0 ... ok
test language::interpreter::tests::access_squeeze_panic - should panic ... ok
test language::interpreter::tests::access_squeeze_1 ... ok
test language::interpreter::tests::access_tensor ... ok
test language::interpreter::tests::access_transpose_0 ... ok
test language::interpreter::tests::access_transpose_1 ... ok
test language::interpreter::tests::access_transpose_2 ... ok
test language::interpreter::tests::access_transpose_panic_0 - should panic ... ok
test language::interpreter::tests::access_transpose_panic_1 - should panic ... ok
test language::from_relay::tests::softmax_0 ... ok
test codegen::tests::relay_op_maxpool2d_resnet_3x3 ... ok
test language::interpreter::tests::access_windows_2 ... ok
test language::from_relay::tests::softmax_1 ... ok
test language::interpreter::tests::access_windows_1 ... ok
test language::interpreter::tests::access_windows ... ok
test language::interpreter::tests::compute_elementwise_add_0 ... ok
test language::interpreter::tests::compute_elementwise_div ... ok
test language::interpreter::tests::compute_dot_product_2 ... ok
test language::interpreter::tests::compute_dot_product_1 ... ok
test language::interpreter::tests::compute_dot_product_0 ... ok
test language::interpreter::tests::access_windows_from_max_pool ... ok
test language::interpreter::tests::compute_elementwise_mul_0 ... ok
test language::interpreter::tests::compute_negative ... ok
test language::interpreter::tests::compute_reduce_max_2 ... ok
test language::interpreter::tests::compute_reduce_max_1 ... ok
test language::interpreter::tests::compute_reduce_max_0 ... ok
test language::interpreter::tests::compute_reduce_max_3 ... ok
test language::interpreter::tests::compute_reduce_mean_0 ... ok
test language::interpreter::tests::compute_reduce_mean_1 ... ok
test language::interpreter::tests::compute_reduce_mean_3 ... ok
test language::interpreter::tests::compute_reduce_mean_2 ... ok
test language::interpreter::tests::compute_reduce_sum_0 ... ok
test language::interpreter::tests::compute_reduce_sum_1 ... ok
test language::interpreter::tests::compute_reduce_sum_3 ... ok
test language::interpreter::tests::compute_reduce_sum_2 ... ok
test language::interpreter::tests::compute_relu_1 ... ok
test language::interpreter::tests::compute_relu_0 ... ok
test language::interpreter::tests::compute_softmax ... ok
test language::interpreter::tests::pad_type ... ok
test language::interpreter::tests::shape ... ok
test language::interpreter::tests::literal_0 ... ok
test language::interpreter::tests::max_pool2d ... ok
test language::interpreter::tests::compute_sqrt ... ok
test language::interpreter::tests::shape_insert_axis_panic - should panic ... ok
test language::interpreter::tests::shape_insert_axis_2 ... ok
test language::interpreter::tests::shape_insert_axis_1 ... ok
test language::interpreter::tests::shape_insert_axis_0 ... ok
test language::interpreter::tests::shape_of ... ok
test language::interpreter::tests::shape_remove_axis_0 ... ok
test language::interpreter::tests::shape_remove_axis_panic - should panic ... ok
test language::interpreter::tests::shape_remove_axis_2 ... ok
test language::interpreter::tests::shape_remove_axis_1 ... ok
test language::interpreter::tests::slice_shape_1 ... ok
test language::interpreter::tests::slice_shape_0 ... ok
test language::interpreter::tests::usize ... ok
test language::interpreter::tests::slice_shape_2 ... ok
test language::interpreter::tests::symbol ... ok
test language::language::bool_vec_range_set_tests::test ... ok
test language::language::bool_vec_range_set_tests::insert_elements_1 ... ok
test language::language::bool_vec_range_set_tests::remove_elements ... ok
test language::language::bool_vec_range_set_tests::insert_elements_0 ... ok
test language::language::bool_vec_range_set_tests::covered ... ok
test language::language::range_hash_set_tests::insert_elements_preserve_ranges ... ok
test language::language::tests::access ... ok
test language::language::range_hash_set_tests::covered ... ok
test language::language::range_hash_set_tests::remove_elements ... ok
test language::language::range_hash_set_tests::insert_elements_break_ranges ... ok
test language::language::tests::access_broadcast ... ok
test language::language::tests::access_concatenate_0 ... ok
test language::language::tests::access_cartesian_product ... ok
test language::language::tests::access_concatenate_panic_0 - should panic ... ok
test language::language::tests::access_concatenate_1 ... ok
test language::language::tests::access_concatenate_panic_1 - should panic ... ok
test language::language::tests::access_invalid - should panic ... ok
test language::language::tests::access_insert_axis_panic - should panic ... ok
test language::language::tests::access_insert_axis ... ok
test language::language::tests::access_cartesian_product_zero_padding ... ok
test language::language::tests::access_move_axis_panic_1 - should panic ... ok
test language::language::tests::access_pad_min_padding ... ok
test language::language::tests::access_literal ... ok
test language::language::tests::access_pad_zero_padding_1 ... ok
test language::language::tests::access_pad_zero_padding_0 ... ok
test language::language::tests::access_pad_zero_padding_panic - should panic ... ok
test language::language::tests::access_pad_zero_padding_2 ... ok
test language::language::tests::access_pair_panic - should panic ... ok
test language::language::tests::access_pair ... ok
test language::language::tests::access_pad_zero_padding_3 ... ok
test language::language::tests::access_shift_right_0 ... ok
test language::language::tests::access_shift_right_1 ... ok
test language::language::tests::access_slice_panic - should panic ... ok
test language::language::tests::access_slice_1 ... ok
test language::language::tests::access_slice_0 ... ok
test language::language::tests::access_shift_right_2 ... ok
test language::language::tests::access_slice_2 ... ok
test language::language::tests::access_squeeze_panic - should panic ... ok
test language::language::tests::access_squeeze ... ok
test language::language::tests::access_transpose ... ok
test language::language::tests::access_slice_zero_pad_0 ... ok
test language::language::tests::access_slice_zero_pad_1 ... ok
test language::language::tests::access_transpose_0 ... ok
test language::language::tests::access_transpose_1 ... ok
test language::language::tests::access_transpose_2 ... ok
test language::language::tests::access_transpose_4 ... ok
test language::language::tests::access_transpose_3 ... ok
test language::language::tests::access_transpose_panic_2 - should panic ... ok
test language::language::tests::access_transpose_5 ... ok
test language::language::tests::access_transpose_panic_1 - should panic ... ok
test language::language::tests::access_transpose_panic_0 - should panic ... ok
test language::language::tests::access_windows ... ok
test language::language::tests::compute_dot_product_panic - should panic ... ok
test language::language::tests::batch_norm_inference_panic - should panic ... ok
test language::language::tests::compute_elementwise_add_0 ... ok
test language::language::tests::batch_norm_inference ... ok
test language::language::tests::compute_dot_product ... ok
test language::language::tests::compute_elementwise_add_panic - should panic ... ok
test language::language::tests::compute_elementwise_mul_0 ... ok
test language::language::tests::compute_elementwise_div ... ok
test language::language::tests::compute_elementwise_add_2 ... ok
test language::language::tests::compute_elementwise_add_1 ... ok
test language::language::tests::compute_elementwise_mul_panic - should panic ... ok
test language::language::tests::compute_reduce_max_0 ... ok
test language::language::tests::compute_negative ... ok
test language::language::tests::compute_elementwise_mul_2 ... ok
test language::language::tests::compute_elementwise_mul_1 ... ok
test language::language::tests::compute_reduce_max_1 ... ok
test language::language::tests::compute_reduce_sum_1 ... ok
test language::language::tests::compute_reduce_sum_0 ... ok
test language::language::tests::compute_reduce_mean_1 ... ok
test language::language::tests::compute_reduce_mean_0 ... ok
test language::language::tests::compute_relu ... ok
test language::language::tests::compute_softmax_1 - should panic ... ok
test language::language::tests::compute_softmax_0 - should panic ... ok
test language::language::tests::compute_sqrt ... ok
test language::language::tests::compute_softmax_2 ... ok
test language::language::tests::construct_tuple ... ok
test language::language::tests::list ... ok
test language::language::tests::literal_0 ... ok
test language::language::tests::conv2d ... ok
test language::language::tests::flatten_reshape_panic - should panic ... ok
test language::language::tests::reaccess ... ok
test language::language::tests::flatten_reshape ... ok
test language::language::tests::relay_operator_call_add ... ok
test language::language::tests::relay_operator_call_add_panic_types - should panic ... ok
test language::language::tests::relay_operator_call_add_panic_broadcast - should panic ... ok
test language::language::tests::relay_operator_call_batch_flatten_panic - should panic ... ok
test language::language::tests::relay_operator_call_bias_add_panic - should panic ... ok
test language::language::tests::relay_operator_call_batch_flatten ... ok
test language::language::tests::relay_operator_call_bias_add ... ok
test language::from_relay::tests::sqrt ... ok
test language::language::tests::relay_operator_call_global_avg_pool2d_panic - should panic ... ok
test language::language::tests::relay_operator_call_global_avg_pool2d_nhwc ... ok
test language::language::tests::relay_operator_call_avgpool2d ... ok
test language::language::tests::relay_operator_call_global_avg_pool2d_nchw ... ok
test language::language::tests::relay_operator_call_leaky_relu ... ok
test language::language::tests::relay_operator_call_max_pool2d_nhwc ... ok
test language::language::tests::relay_operator_call_max_pool2d_panic - should panic ... ok
test language::language::tests::relay_operator_call_max_pool2d_nchw ... ok
test language::language::tests::relay_operator_call_maximum ... ok
test language::language::tests::relay_operator_call_minimum ... ok
test language::language::tests::relay_operator_call_relu_panic - should panic ... ok
test language::language::tests::relay_operator_call_relu ... ok
test language::language::tests::relay_operator_call_softmax_panic - should panic ... ok
test language::language::tests::relay_operator_call_sigmoid ... ok
test language::language::tests::relay_operator_call_softmax ... ok
test language::language::tests::shape_insert_axis_1 ... ok
test language::language::tests::shape_insert_axis_0 ... ok
test language::language::tests::shape_insert_axis_panic - should panic ... ok
test language::language::tests::shape_of ... ok
test language::language::tests::shape_remove_axis_0 ... ok
test language::language::tests::shape_remove_axis_panic - should panic ... ok
test language::language::tests::shape_remove_axis_2 ... ok
test language::language::tests::shape_remove_axis_1 ... ok
test language::language::tests::slice_shape_invalid_slice - should panic ... ok
test language::language::tests::relay_operator_call_upsampling ... ok
test language::language::tests::slice_shape ... ok
test language::language::tests::systolic_array ... ok
test language::language::tests::systolic_array_panic_0 - should panic ... ok
test language::language::tests::systolic_array_with_blocking_0 ... ok
test language::language::tests::systolic_array_with_blocking_2 ... ok
test language::language::tests::systolic_array_with_blocking_panic - should panic ... ok
test language::language::tests::systolic_array_with_blocking_3 ... ok
test language::language::tests::systolic_array_conv2d_im2col_nhwc_hwio_with_blocking ... ok
test language::language::tests::systolic_array_conv2d_im2col_nchw_oihw_with_blocking ... ok
test language::language::tests::systolic_array_conv2d_nhwc_hwio_with_blocking ... ok
test language::language::tests::systolic_array_conv2d_nchw_oihw_with_blocking ... ok
test language::language::tests::zero_padding ... ok
test language::language::tests::tuple_get_item ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access ... ok
test language::rewrites::tests::access_slice_access_transpose_composition_commutative_3 ... ok
test language::rewrites::tests::access_slice_access_transpose_composition_commutative_2 ... ok
test language::rewrites::tests::access_slice_access_transpose_composition_commutative_1 ... ok
test language::rewrites::tests::access_slice_access_transpose_composition_commutative_0 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_cartesian_product_left ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_slice_2 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_slice_1 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_slice_0 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_cartesian_product_right ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_cartesian_product_same_item_axis_1 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_cartesian_product_same_item_axis_0 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_transpose_3 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_transpose_2 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_transpose_1 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_access_transpose_0 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_compute_dot_product_item_access_1 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_compute_dot_product_item_access_0 ... ok
test language::rewrites::tests::bubble_access_concatenate_through_compute_dot_product_not_item_axis ... ok
test language::rewrites::tests::bubble_access_slice_through_access_cartesian_product_left ... ok
test language::rewrites::tests::bubble_access_slice_through_access_cartesian_product_right ... ok
test language::rewrites::tests::bubble_access_slice_through_compute_dot_product_not_item_axis ... ok
test language::rewrites::tests::bubble_access_slice_through_compute_dot_product_item_axis_not_tuple_axis ... ok
test language::rewrites::tests::bubble_access_slice_through_access_cartesian_product_same_item_axis ... ok
test language::rewrites::tests::bubble_access_slice_through_access_pad_inequal_axes ... ok
test language::rewrites::tests::bubble_access_transpose_through_access_pad ... ok
test language::rewrites::tests::collapse_nested_accesses ... ok
test language::rewrites::tests::conv2d_im2col_fc_systolic_array - should panic ... ok
test language::rewrites::tests::bubble_reshape_through_dot_product ... ok
test language::rewrites::tests::collapse_nested_transposes ... ok
test language::rewrites::tests::pad_slice_accesses_pad_to_multiples ... ok
test language::rewrites::tests::pad_slice_accesses_pad_to_closest_multiple ... ok
test language::rewrites::tests::remove_trivial_transpose ... ok
test language::rewrites::tests::slice_concatenate_accesses ... ok
test language::rewrites::tests::slice_concatenate_tensor_accesses ... ok
test language::from_relay::tests::squeeze ... ok
test language::rewrites::tests::bubble_reshape_through_cartesian_product ... ok
test language::rewrites::tests::conv2d_im2col_systolic_array ... ok
test language::rewrites::tests::conv2d_im2col_systolic_array_1 ... ok
test language::rewrites::tests::flatten_unflatten_access_windows ... ok
test language::rewrites::tests::systolic_array_conv2d_nchw_oihw_with_blocking ... ok
test language::rewrites::tests::systolic_array_conv2d_nhwc_hwio_with_blocking ... ok
test language::rewrites::tests::systolic_array_with_blocking ... ok
test language::from_relay::tests::transpose ... ok
test language::rewrites::tests::slice_concatenate_accesses_divide_into_0 ... ok
test language::rewrites::tests::systolic_array_conv2d_im2col_nchw_oihw_with_blocking ... ok
test language::rewrites::tests::systolic_array_conv2d_im2col_nhwc_hwio_with_blocking ... ok

test result: ok. 303 passed; 0 failed; 8 ignored; 0 measured; 0 filtered out; finished in 102.67s

Jan 29 16:23:49.772  INFO cargo_tarpaulin::report: Coverage Results:
|| Tested/Total Lines:
|| src/codegen.rs: 1283/1420 +0.14%
|| src/extraction/ilp.rs: 0/69 +0.00%
|| src/extraction/mod.rs: 75/145 +0.69%
|| src/hw_design_language.rs: 27/28 +0.00%
|| src/language/from_relay/mod.rs: 584/705 +0.00%
|| src/language/interpreter.rs: 952/1246 +0.00%
|| src/language/language.rs: 1958/2291 +0.00%
|| src/language/rewrites.rs: 1168/1315 +0.00%
|| tests/codegen-mlp.rs: 31/35 +0.00%
|| tests/common/mod.rs: 2/2 +0.00%
|| tests/interpret-conv2d.rs: 14/15 +0.00%
|| tests/mobilenet-relay-to-glenside.rs: 22/22 +0.00%
|| tests/mobilenet-try-to-run-rewrites.rs: 41/42 +0.00%
|| tests/regular-multilayer-perceptron.rs: 24/24 +0.00%
|| tests/regular-small-multilayer-perceptron.rs: 26/26 +0.00%
|| tests/resnet18_relay_to_glenside.rs: 11/11 +0.00%
|| tests/run-glenside-examples.rs: 23/24 +0.00%
|| 
84.11% coverage, 6241/7420 lines covered, +0.040431266846368885% change in coverage

[ninehusky]

Whoops, you're right! Not sure why running the commands again didn't fix things initially. Thanks so much for the fast response and quick help!