Wave 5 - `tm_t_mult_events` shinytests

[vedhav]

Part of #1108

[github-actions[bot]]

Unit Tests Summary

  1 files  ± 0   41 suites  +1   16m 0s :stopwatch: -54s 380 tests + 7  270 :white_check_mark: + 7  110 :zzz: ±0  0 :x: ±0  747 runs  +20  525 :white_check_mark: +20  222 :zzz: ±0  0 :x: ±0 

Results for commit 5b811ee3. ± Comparison against base commit 85873688.

:recycle: This comment has been updated with latest results.

[github-actions[bot]]

Unit Test Performance Difference

Test Suite	$Status$	Time on main	$±Time$	$±Tests$	$±Skipped$	$±Failures$	$±Errors$
shinytest2-tm_a_gee	👶		$+120.76$	$+48$	$0$	$0$	$0$
shinytest2-tm_g_barchart_simple	👶		$+206.37$	$+73$	$0$	$0$	$0$
shinytest2-tm_g_ci	👶		$+97.80$	$+41$	$0$	$0$	$0$
shinytest2-tm_g_forest_rsp	👶		$+161.97$	$+48$	$0$	$0$	$0$
shinytest2-tm_g_ipp	👶		$+98.58$	$+45$	$0$	$0$	$0$
shinytest2-tm_g_km	👶		$+219.05$	$+80$	$0$	$0$	$0$
shinytest2-tm_t_mult_events	👶		$+51.37$	$+20$	$0$	$0$	$0$

Additional test case details

| Test Suite | $Status$ | Time on `main` | $±Time$ | Test Case | |:-----|:----:|:----:|:----:|:-----| | shinytest2-tm_a_gee | 👶 | | $+7.38$ | e2e_tm_a_gee_Change_in_arm_var_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+6.84$ | e2e_tm_a_gee_Deselection_of_arm_var_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+6.74$ | e2e_tm_a_gee_Deselection_of_conf_level_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+6.65$ | e2e_tm_a_gee_Deselection_of_cor_struct_does_not_throw_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+6.83$ | e2e_tm_a_gee_Deselection_of_id_var_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+6.73$ | e2e_tm_a_gee_Deselection_of_paramcd_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+7.24$ | e2e_tm_a_gee_Deselection_of_visit_var_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+7.22$ | e2e_tm_a_gee_Module_initializes_in_teal_without_errors_and_produces_table_output. | | shinytest2-tm_a_gee | 👶 | | $+7.36$ | e2e_tm_a_gee_Selection_of_conf_level_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+6.82$ | e2e_tm_a_gee_Selection_of_conf_level_out_of_0_1_range_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+7.26$ | e2e_tm_a_gee_Selection_of_cor_struct_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+7.37$ | e2e_tm_a_gee_Selection_of_cov_var_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+7.66$ | e2e_tm_a_gee_Selection_of_id_var_does_not_change_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+7.24$ | e2e_tm_a_gee_Selection_of_output_table_changes_the_table_and_doesn_t_throw_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+7.49$ | e2e_tm_a_gee_Selection_of_paramcd_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+7.37$ | e2e_tm_a_gee_Selection_of_visit_var_does_not_change_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+6.57$ | e2e_tm_a_gee_Starts_with_specified_label_id_var_arm_var_visit_var_paramcd_cov_var_conf_level_and_conf_struct. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.74$ | e2e_tm_g_barchart_simple_Changing_barlayout_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.88$ | e2e_tm_g_barchart_simple_Changing_expand_y_range_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.75$ | e2e_tm_g_barchart_simple_Changing_facet_scale_x_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.83$ | e2e_tm_g_barchart_simple_Changing_facet_scale_y_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.85$ | e2e_tm_g_barchart_simple_Changing_flip_axis_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.93$ | e2e_tm_g_barchart_simple_Changing_label_bars_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.14$ | e2e_tm_g_barchart_simple_Changing_rotate_bar_labels_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.80$ | e2e_tm_g_barchart_simple_Changing_rotate_x_label_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.76$ | e2e_tm_g_barchart_simple_Changing_rotate_y_label_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.95$ | e2e_tm_g_barchart_simple_Changing_show_n_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+9.39$ | e2e_tm_g_barchart_simple_De_selection_of_fill_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.40$ | e2e_tm_g_barchart_simple_De_selection_of_x_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.51$ | e2e_tm_g_barchart_simple_De_selection_of_y_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+7.38$ | e2e_tm_g_barchart_simple_Deselection_of_x_throws_validation_error. | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.47$ | e2e_tm_g_barchart_simple_Duplicate_between_x_and_fill_selection_throws_validation_error | | shinytest2-tm_g_barchart_simple | 👶 | | $+9.08$ | e2e_tm_g_barchart_simple_Duplicate_between_x_and_x_facet_selection_throws_validation_error | | shinytest2-tm_g_barchart_simple | 👶 | | $+9.33$ | e2e_tm_g_barchart_simple_Duplicate_between_x_and_y_facet_selection_throws_validation_error | | shinytest2-tm_g_barchart_simple | 👶 | | $+6.93$ | e2e_tm_g_barchart_simple_Module_initializes_in_teal_without_errors_and_produces_output. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.05$ | e2e_tm_g_barchart_simple_Selection_of_fill_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.88$ | e2e_tm_g_barchart_simple_Selection_of_x_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+10.35$ | e2e_tm_g_barchart_simple_Selection_of_x_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+10.35$ | e2e_tm_g_barchart_simple_Selection_of_y_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+7.61$ | e2e_tm_g_barchart_simple_Starts_with_specified_label_id_var_arm_var_visit_var_paramcd_cov_var_conf_level_and_conf_struct. | | shinytest2-tm_g_ci | 👶 | | $+6.80$ | e2e_tm_g_ci_Deselecting_AVISIT_filter_value_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+6.82$ | e2e_tm_g_ci_Deselecting_PARAMCD_filter_value_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+7.03$ | e2e_tm_g_ci_Deselecting_color_column_changes_plot_output_and_doesn_t_throw_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+6.81$ | e2e_tm_g_ci_Deselecting_x_var_column_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+6.80$ | e2e_tm_g_ci_Deselecting_y_var_column_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+6.64$ | e2e_tm_g_ci_Module_initializes_with_specified_label_x_var_y_var_ADLB_filters_color_conf_level_and_stat. | | shinytest2-tm_g_ci | 👶 | | $+7.21$ | e2e_tm_g_ci_Selecting_AVISIT_filter_value_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+7.20$ | e2e_tm_g_ci_Selecting_PARAMCD_filter_value_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+7.25$ | e2e_tm_g_ci_Selecting_color_column_changes_plot_output_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+7.09$ | e2e_tm_g_ci_Selecting_confidence_interval_value_changes_plot_and_doesn_t_throw_any_errors. | | shinytest2-tm_g_ci | 👶 | | $+7.16$ | e2e_tm_g_ci_Selecting_statistic_to_use_changes_a_plot_and_doesn_t_throw_any_errors. | | shinytest2-tm_g_ci | 👶 | | $+7.29$ | e2e_tm_g_ci_Selecting_x_var_column_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+7.50$ | e2e_tm_g_ci_Selecting_y_var_column_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+6.18$ | e2e_tm_g_ci_example_ci_module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.41$ | e2e_tm_g_forest_rsp_Changing_font_size_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.53$ | e2e_tm_g_forest_rsp_Changing_rel_width_forest_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+8.30$ | e2e_tm_g_forest_rsp_Deselecting_arm_var_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+8.78$ | e2e_tm_g_forest_rsp_Deselecting_conf_level_or_selecting_outside_the_range_of_0_1_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+8.38$ | e2e_tm_g_forest_rsp_Deselecting_paramcd_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+7.95$ | e2e_tm_g_forest_rsp_Deselecting_responders_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.42$ | e2e_tm_g_forest_rsp_Deselecting_strata_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+8.93$ | e2e_tm_g_forest_rsp_Deselecting_subgroup_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+7.34$ | e2e_tm_g_forest_rsp_Module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_forest_rsp | 👶 | | $+8.13$ | e2e_tm_g_forest_rsp_Module_initializes_with_specified_label_arm_var_paramcd_aval_var_responders_subgroup_var_strata_var_conf_level_fixed_symbol_size_rel_width_forest_font_size. | | shinytest2-tm_g_forest_rsp | 👶 | | $+8.22$ | e2e_tm_g_forest_rsp_Selecting_a_non_factors_column_in_subgroup_var_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.52$ | e2e_tm_g_forest_rsp_Selecting_arm_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.35$ | e2e_tm_g_forest_rsp_Selecting_conf_level_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+10.75$ | e2e_tm_g_forest_rsp_Selecting_paramcd_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.38$ | e2e_tm_g_forest_rsp_Selecting_responders_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.41$ | e2e_tm_g_forest_rsp_Selecting_strata_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.83$ | e2e_tm_g_forest_rsp_Selecting_subgroup_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.34$ | e2e_tm_g_forest_rsp_Unsetting_fixed_symbol_size_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+7.19$ | e2e_tm_g_ipp_Changing_add_avalu_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+7.14$ | e2e_tm_g_ipp_Changing_add_baseline_hline_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+7.55$ | e2e_tm_g_ipp_Changing_separate_by_obs_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+7.05$ | e2e_tm_g_ipp_Changing_suppress_legend_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+6.89$ | e2e_tm_g_ipp_Deselecting_arm_var_column_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+6.87$ | e2e_tm_g_ipp_Deselecting_aval_var_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+6.84$ | e2e_tm_g_ipp_Deselecting_paramcd_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+6.91$ | e2e_tm_g_ipp_Deselecting_visit_var_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+6.26$ | e2e_tm_g_ipp_Module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_ipp | 👶 | | $+7.23$ | e2e_tm_g_ipp_Selecting_arm_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+7.22$ | e2e_tm_g_ipp_Selecting_aval_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+7.22$ | e2e_tm_g_ipp_Selecting_paramcd_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+7.26$ | e2e_tm_g_ipp_Selecting_visit_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+6.96$ | e2e_tm_g_ipp_Starts_with_specified_label_parentname_arm_var_paramcd_id_var_visit_var_aval_var_avalu_var_baseline_var_add_baseline_hline_separate_by_obs_suppress_legend_add_avalu. | | shinytest2-tm_g_km | 👶 | | $+8.47$ | e2e_tm_g_km_Changing_arm_var_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+8.22$ | e2e_tm_g_km_Changing_compare_arms_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+8.38$ | e2e_tm_g_km_Changing_conf_level_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+9.13$ | e2e_tm_g_km_Changing_facet_var_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+8.31$ | e2e_tm_g_km_Changing_font_size_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+8.47$ | e2e_tm_g_km_Changing_paramcd_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+8.60$ | e2e_tm_g_km_Changing_pval_method_coxph_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+8.40$ | e2e_tm_g_km_Changing_rel_height_plot_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+8.42$ | e2e_tm_g_km_Changing_show_ci_ribbon_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+8.22$ | e2e_tm_g_km_Changing_show_km_table_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+8.36$ | e2e_tm_g_km_Changing_strata_var_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+8.33$ | e2e_tm_g_km_Changing_ties_coxph_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+8.32$ | e2e_tm_g_km_Changing_xlab_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+9.09$ | e2e_tm_g_km_Changing_xticks_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+8.27$ | e2e_tm_g_km_Changing_yval_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+7.66$ | e2e_tm_g_km_Deselecting_arm_var_throws_validation_error. | | shinytest2-tm_g_km | 👶 | | $+8.22$ | e2e_tm_g_km_Deselecting_compare_arms_sets_it_to_FALSE. | | shinytest2-tm_g_km | 👶 | | $+7.52$ | e2e_tm_g_km_Deselecting_conf_level_throws_validation_error. | | shinytest2-tm_g_km | 👶 | | $+7.58$ | e2e_tm_g_km_Deselecting_paramcd_throws_validation_error. | | shinytest2-tm_g_km | 👶 | | $+8.34$ | e2e_tm_g_km_Deselecting_pval_method_coxph_gives_no_validation_error. | | shinytest2-tm_g_km | 👶 | | $+8.40$ | e2e_tm_g_km_Deselecting_strata_var_does_not_throw_errors. | | shinytest2-tm_g_km | 👶 | | $+8.40$ | e2e_tm_g_km_Deselecting_ties_coxph_gives_no_validation_error. | | shinytest2-tm_g_km | 👶 | | $+6.82$ | e2e_tm_g_km_Module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_km | 👶 | | $+7.45$ | e2e_tm_g_km_Starts_with_specified_collapsed_additional_plot_settings. | | shinytest2-tm_g_km | 👶 | | $+7.17$ | e2e_tm_g_km_Starts_with_specified_collapsed_comparison_settings. | | shinytest2-tm_g_km | 👶 | | $+7.14$ | e2e_tm_g_km_Starts_with_specified_groups. | | shinytest2-tm_g_km | 👶 | | $+7.34$ | e2e_tm_g_km_Starts_with_specified_paramcd_aval_var_cnsr_var_facet_var_arm_var_compare_arms_strata_var. | | shinytest2-tm_t_mult_events | 👶 | | $+7.19$ | e2e_tm_t_mult_events_Deselection_of_arm_var_variable_throws_validation_error. | | shinytest2-tm_t_mult_events | 👶 | | $+7.36$ | e2e_tm_t_mult_events_Deselection_of_hlt_variable_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_t_mult_events | 👶 | | $+7.17$ | e2e_tm_t_mult_events_Deselection_of_llt_variable_throws_validation_error. | | shinytest2-tm_t_mult_events | 👶 | | $+6.52$ | e2e_tm_t_mult_events_Module_initializes_in_teal_without_errors_and_produces_table_output. | | shinytest2-tm_t_mult_events | 👶 | | $+8.28$ | e2e_tm_t_mult_events_Selecting_arm_var_variable_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_t_mult_events | 👶 | | $+8.06$ | e2e_tm_t_mult_events_Selecting_hlt_variable_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_t_mult_events | 👶 | | $+6.79$ | e2e_tm_t_mult_events_Starts_with_specified_label_arm_var_hlt_llt_add_total_drop_arm_levels |

Results for commit c7bb92c0dbf8d6b076db28b8726b418bd007037b

♻️ This comment has been updated with latest results.