search

containerd / runwasi

Facilitates running Wasm / WASI workloads managed by containerd
Apache License 2.0
1.06k stars 88 forks source link

All bench tests are "Ignored" #611

Closed Mossaka closed 3 months ago

Mossaka commented 3 months ago

https://github.com/containerd/runwasi/pull/126 adds initial support for benchmarking.

Reproduce

  1. Fetch webassembly-benchmarks 
    git submodule update --init --recursive

run cargo bench

What I got is:

running 40 tests
test container::context::tests::test_get_args ... ignored
test container::context::tests::test_get_args_return_empty ... ignored
test container::context::tests::test_get_args_returns_all ... ignored
test container::context::tests::test_get_module_returns_function ... ignored
test container::context::tests::test_get_module_returns_none_when_not_present ... ignored
test container::context::tests::test_get_module_returns_start ... ignored
test container::context::tests::test_loading_strategy_is_file_when_no_layers ... ignored
test container::context::tests::test_loading_strategy_is_oci_when_layers_present ... ignored
test container::tests::test_validation_error ... ignored
test sandbox::containerd::client::tests::test_layers_are_precompiled ... ignored
test sandbox::containerd::client::tests::test_layers_are_precompiled_but_not_for_all_layers ... ignored
test sandbox::containerd::client::tests::test_layers_are_precompiled_for_multiple_layers ... ignored
test sandbox::containerd::client::tests::test_layers_are_precompiled_once ... ignored
test sandbox::containerd::client::tests::test_layers_are_recompiled_if_version_changes ... ignored
test sandbox::containerd::client::tests::test_layers_do_not_need_precompiled_if_new_layers_are_add_to_new_image ... ignored
test sandbox::containerd::client::tests::test_layers_do_not_need_precompiled_if_new_layers_are_added_to_existing_image ... ignored
test sandbox::containerd::client::tests::test_layers_when_precompile_not_supported ... ignored
test sandbox::containerd::client::tests::test_save_content ... ignored
test sandbox::error::tests::test_error_to_ttrpc_status ... ignored
test sandbox::instance::noptests::test_nop_delete_after_create ... ignored
test sandbox::instance::noptests::test_nop_kill_sigint ... ignored
test sandbox::instance::noptests::test_nop_kill_sigkill ... ignored
test sandbox::instance::noptests::test_nop_kill_sigterm ... ignored
test sandbox::instance_utils::tests::test_determine_rootdir_with_options_file ... ignored
test sandbox::instance_utils::tests::test_determine_rootdir_without_options_file ... ignored
test sandbox::shim::local::tests::test_cri_task ... ignored
test sandbox::shim::local::tests::test_delete_after_create ... ignored
test sandbox::shim::local::tests::test_task_lifecycle ... ignored
test sandbox::stdio::test::test_maybe_open_stdio ... ignored
test sandbox::sync::test::basic ... ignored
test sandbox::sync::test::basic_double_set ... ignored
test sandbox::sync::test::basic_threaded ... ignored
test sandbox::sync::test::basic_timeout_1ms ... ignored
test sandbox::sync::test::basic_timeout_none ... ignored
test sandbox::sync::test::basic_timeout_zero ... ignored
test sandbox::sync::test::clone ... ignored
test sandbox::sync::test::guard ... ignored
test sandbox::sync::test::guard_no_op ... ignored
test sandbox::sync::test::unset_timeout_1ms ... ignored
test sandbox::sync::test::unset_timeout_zero ... ignored

Anyone knows how to run the existing bench tests?