Wave 7 - `tm_t_summary_by` shinytests

[vedhav]

Part of #1108

[github-actions[bot]]

Unit Tests Summary

  1 files  ± 0   41 suites  +1   20m 49s :stopwatch: + 3m 55s 380 tests + 7  270 :white_check_mark: + 7  110 :zzz: ±0  0 :x: ±0  760 runs  +33  538 :white_check_mark: +33  222 :zzz: ±0  0 :x: ±0 

Results for commit 761b0c3b. ± Comparison against base commit 85873688.

:recycle: This comment has been updated with latest results.

[github-actions[bot]]

Unit Test Performance Difference

Test Suite	$Status$	Time on main	$±Time$	$±Tests$	$±Skipped$	$±Failures$	$±Errors$
shinytest2-tm_a_gee	👶		$+146.77$	$+48$	$0$	$0$	$0$
shinytest2-tm_g_barchart_simple	👶		$+262.42$	$+73$	$0$	$0$	$0$
shinytest2-tm_g_ci	👶		$+128.23$	$+41$	$0$	$0$	$0$
shinytest2-tm_g_forest_rsp	👶		$+208.54$	$+48$	$0$	$0$	$0$
shinytest2-tm_g_ipp	👶		$+124.58$	$+45$	$0$	$0$	$0$
shinytest2-tm_g_km	👶		$+280.78$	$+80$	$0$	$0$	$0$
shinytest2-tm_t_summary_by	👶		$+93.41$	$+33$	$0$	$0$	$0$

Additional test case details

| Test Suite | $Status$ | Time on `main` | $±Time$ | Test Case | |:-----|:----:|:----:|:----:|:-----| | shinytest2-tm_a_gee | 👶 | | $+8.67$ | e2e_tm_a_gee_Change_in_arm_var_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+8.13$ | e2e_tm_a_gee_Deselection_of_arm_var_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+7.95$ | e2e_tm_a_gee_Deselection_of_conf_level_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+8.21$ | e2e_tm_a_gee_Deselection_of_cor_struct_does_not_throw_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+7.97$ | e2e_tm_a_gee_Deselection_of_id_var_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+8.09$ | e2e_tm_a_gee_Deselection_of_paramcd_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+8.74$ | e2e_tm_a_gee_Deselection_of_visit_var_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+9.10$ | e2e_tm_a_gee_Module_initializes_in_teal_without_errors_and_produces_table_output. | | shinytest2-tm_a_gee | 👶 | | $+9.19$ | e2e_tm_a_gee_Selection_of_conf_level_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+7.93$ | e2e_tm_a_gee_Selection_of_conf_level_out_of_0_1_range_throws_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+9.05$ | e2e_tm_a_gee_Selection_of_cor_struct_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+9.25$ | e2e_tm_a_gee_Selection_of_cov_var_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+9.58$ | e2e_tm_a_gee_Selection_of_id_var_does_not_change_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+8.95$ | e2e_tm_a_gee_Selection_of_output_table_changes_the_table_and_doesn_t_throw_validation_error. | | shinytest2-tm_a_gee | 👶 | | $+8.93$ | e2e_tm_a_gee_Selection_of_paramcd_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+9.01$ | e2e_tm_a_gee_Selection_of_visit_var_does_not_change_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_a_gee | 👶 | | $+8.00$ | e2e_tm_a_gee_Starts_with_specified_label_id_var_arm_var_visit_var_paramcd_cov_var_conf_level_and_conf_struct. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.65$ | e2e_tm_g_barchart_simple_Changing_barlayout_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.82$ | e2e_tm_g_barchart_simple_Changing_expand_y_range_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.48$ | e2e_tm_g_barchart_simple_Changing_facet_scale_x_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.27$ | e2e_tm_g_barchart_simple_Changing_facet_scale_y_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.50$ | e2e_tm_g_barchart_simple_Changing_flip_axis_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.99$ | e2e_tm_g_barchart_simple_Changing_label_bars_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+14.74$ | e2e_tm_g_barchart_simple_Changing_rotate_bar_labels_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.44$ | e2e_tm_g_barchart_simple_Changing_rotate_x_label_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.07$ | e2e_tm_g_barchart_simple_Changing_rotate_y_label_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.82$ | e2e_tm_g_barchart_simple_Changing_show_n_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.38$ | e2e_tm_g_barchart_simple_De_selection_of_fill_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+10.38$ | e2e_tm_g_barchart_simple_De_selection_of_x_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.11$ | e2e_tm_g_barchart_simple_De_selection_of_y_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+9.19$ | e2e_tm_g_barchart_simple_Deselection_of_x_throws_validation_error. | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.15$ | e2e_tm_g_barchart_simple_Duplicate_between_x_and_fill_selection_throws_validation_error | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.75$ | e2e_tm_g_barchart_simple_Duplicate_between_x_and_x_facet_selection_throws_validation_error | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.77$ | e2e_tm_g_barchart_simple_Duplicate_between_x_and_y_facet_selection_throws_validation_error | | shinytest2-tm_g_barchart_simple | 👶 | | $+7.69$ | e2e_tm_g_barchart_simple_Module_initializes_in_teal_without_errors_and_produces_output. | | shinytest2-tm_g_barchart_simple | 👶 | | $+13.66$ | e2e_tm_g_barchart_simple_Selection_of_fill_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+11.06$ | e2e_tm_g_barchart_simple_Selection_of_x_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+12.83$ | e2e_tm_g_barchart_simple_Selection_of_x_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+12.79$ | e2e_tm_g_barchart_simple_Selection_of_y_facet_dataset_changes_the_element_and_does_not_throw_validation_errors | | shinytest2-tm_g_barchart_simple | 👶 | | $+8.88$ | e2e_tm_g_barchart_simple_Starts_with_specified_label_id_var_arm_var_visit_var_paramcd_cov_var_conf_level_and_conf_struct. | | shinytest2-tm_g_ci | 👶 | | $+8.75$ | e2e_tm_g_ci_Deselecting_AVISIT_filter_value_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+9.29$ | e2e_tm_g_ci_Deselecting_PARAMCD_filter_value_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+9.06$ | e2e_tm_g_ci_Deselecting_color_column_changes_plot_output_and_doesn_t_throw_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+9.47$ | e2e_tm_g_ci_Deselecting_x_var_column_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+8.73$ | e2e_tm_g_ci_Deselecting_y_var_column_throws_validation_error. | | shinytest2-tm_g_ci | 👶 | | $+9.08$ | e2e_tm_g_ci_Module_initializes_with_specified_label_x_var_y_var_ADLB_filters_color_conf_level_and_stat. | | shinytest2-tm_g_ci | 👶 | | $+9.33$ | e2e_tm_g_ci_Selecting_AVISIT_filter_value_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+9.95$ | e2e_tm_g_ci_Selecting_PARAMCD_filter_value_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+9.53$ | e2e_tm_g_ci_Selecting_color_column_changes_plot_output_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+9.00$ | e2e_tm_g_ci_Selecting_confidence_interval_value_changes_plot_and_doesn_t_throw_any_errors. | | shinytest2-tm_g_ci | 👶 | | $+8.74$ | e2e_tm_g_ci_Selecting_statistic_to_use_changes_a_plot_and_doesn_t_throw_any_errors. | | shinytest2-tm_g_ci | 👶 | | $+9.95$ | e2e_tm_g_ci_Selecting_x_var_column_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+9.49$ | e2e_tm_g_ci_Selecting_y_var_column_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ci | 👶 | | $+7.87$ | e2e_tm_g_ci_example_ci_module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_forest_rsp | 👶 | | $+12.34$ | e2e_tm_g_forest_rsp_Changing_font_size_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+12.47$ | e2e_tm_g_forest_rsp_Changing_rel_width_forest_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+10.45$ | e2e_tm_g_forest_rsp_Deselecting_arm_var_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+10.60$ | e2e_tm_g_forest_rsp_Deselecting_conf_level_or_selecting_outside_the_range_of_0_1_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+10.74$ | e2e_tm_g_forest_rsp_Deselecting_paramcd_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.96$ | e2e_tm_g_forest_rsp_Deselecting_responders_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+12.18$ | e2e_tm_g_forest_rsp_Deselecting_strata_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+11.47$ | e2e_tm_g_forest_rsp_Deselecting_subgroup_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+9.43$ | e2e_tm_g_forest_rsp_Module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_forest_rsp | 👶 | | $+10.52$ | e2e_tm_g_forest_rsp_Module_initializes_with_specified_label_arm_var_paramcd_aval_var_responders_subgroup_var_strata_var_conf_level_fixed_symbol_size_rel_width_forest_font_size. | | shinytest2-tm_g_forest_rsp | 👶 | | $+10.53$ | e2e_tm_g_forest_rsp_Selecting_a_non_factors_column_in_subgroup_var_throws_validation_error. | | shinytest2-tm_g_forest_rsp | 👶 | | $+12.12$ | e2e_tm_g_forest_rsp_Selecting_arm_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+12.54$ | e2e_tm_g_forest_rsp_Selecting_conf_level_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+14.20$ | e2e_tm_g_forest_rsp_Selecting_paramcd_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+11.85$ | e2e_tm_g_forest_rsp_Selecting_responders_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+12.07$ | e2e_tm_g_forest_rsp_Selecting_strata_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+13.06$ | e2e_tm_g_forest_rsp_Selecting_subgroup_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_forest_rsp | 👶 | | $+12.02$ | e2e_tm_g_forest_rsp_Unsetting_fixed_symbol_size_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+8.73$ | e2e_tm_g_ipp_Changing_add_avalu_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+9.12$ | e2e_tm_g_ipp_Changing_add_baseline_hline_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+9.11$ | e2e_tm_g_ipp_Changing_separate_by_obs_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+8.73$ | e2e_tm_g_ipp_Changing_suppress_legend_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+8.81$ | e2e_tm_g_ipp_Deselecting_arm_var_column_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+8.27$ | e2e_tm_g_ipp_Deselecting_aval_var_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+8.84$ | e2e_tm_g_ipp_Deselecting_paramcd_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+8.50$ | e2e_tm_g_ipp_Deselecting_visit_var_throws_validation_error. | | shinytest2-tm_g_ipp | 👶 | | $+8.60$ | e2e_tm_g_ipp_Module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_ipp | 👶 | | $+9.56$ | e2e_tm_g_ipp_Selecting_arm_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+9.17$ | e2e_tm_g_ipp_Selecting_aval_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+9.20$ | e2e_tm_g_ipp_Selecting_paramcd_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+8.68$ | e2e_tm_g_ipp_Selecting_visit_var_changes_plot_and_doesn_t_throw_validation_errors. | | shinytest2-tm_g_ipp | 👶 | | $+9.26$ | e2e_tm_g_ipp_Starts_with_specified_label_parentname_arm_var_paramcd_id_var_visit_var_aval_var_avalu_var_baseline_var_add_baseline_hline_separate_by_obs_suppress_legend_add_avalu. | | shinytest2-tm_g_km | 👶 | | $+10.80$ | e2e_tm_g_km_Changing_arm_var_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+10.26$ | e2e_tm_g_km_Changing_compare_arms_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+11.00$ | e2e_tm_g_km_Changing_conf_level_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+11.90$ | e2e_tm_g_km_Changing_facet_var_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+10.89$ | e2e_tm_g_km_Changing_font_size_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+11.45$ | e2e_tm_g_km_Changing_paramcd_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+11.26$ | e2e_tm_g_km_Changing_pval_method_coxph_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+10.51$ | e2e_tm_g_km_Changing_rel_height_plot_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+10.84$ | e2e_tm_g_km_Changing_show_ci_ribbon_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+10.69$ | e2e_tm_g_km_Changing_show_km_table_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+11.19$ | e2e_tm_g_km_Changing_strata_var_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+10.94$ | e2e_tm_g_km_Changing_ties_coxph_changes_the_plot_without_errors. | | shinytest2-tm_g_km | 👶 | | $+10.71$ | e2e_tm_g_km_Changing_xlab_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+11.10$ | e2e_tm_g_km_Changing_xticks_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+9.88$ | e2e_tm_g_km_Changing_yval_changes_the_plot_and_does_not_throw_validation_errors. | | shinytest2-tm_g_km | 👶 | | $+10.36$ | e2e_tm_g_km_Deselecting_arm_var_throws_validation_error. | | shinytest2-tm_g_km | 👶 | | $+10.75$ | e2e_tm_g_km_Deselecting_compare_arms_sets_it_to_FALSE. | | shinytest2-tm_g_km | 👶 | | $+9.48$ | e2e_tm_g_km_Deselecting_conf_level_throws_validation_error. | | shinytest2-tm_g_km | 👶 | | $+9.35$ | e2e_tm_g_km_Deselecting_paramcd_throws_validation_error. | | shinytest2-tm_g_km | 👶 | | $+10.02$ | e2e_tm_g_km_Deselecting_pval_method_coxph_gives_no_validation_error. | | shinytest2-tm_g_km | 👶 | | $+10.85$ | e2e_tm_g_km_Deselecting_strata_var_does_not_throw_errors. | | shinytest2-tm_g_km | 👶 | | $+10.65$ | e2e_tm_g_km_Deselecting_ties_coxph_gives_no_validation_error. | | shinytest2-tm_g_km | 👶 | | $+8.10$ | e2e_tm_g_km_Module_initializes_in_teal_without_errors_and_produces_plot_output. | | shinytest2-tm_g_km | 👶 | | $+9.57$ | e2e_tm_g_km_Starts_with_specified_collapsed_additional_plot_settings. | | shinytest2-tm_g_km | 👶 | | $+9.35$ | e2e_tm_g_km_Starts_with_specified_collapsed_comparison_settings. | | shinytest2-tm_g_km | 👶 | | $+9.13$ | e2e_tm_g_km_Starts_with_specified_groups. | | shinytest2-tm_g_km | 👶 | | $+9.73$ | e2e_tm_g_km_Starts_with_specified_paramcd_aval_var_cnsr_var_facet_var_arm_var_compare_arms_strata_var. | | shinytest2-tm_t_summary_by | 👶 | | $+9.45$ | e2e_tm_t_summary_by_Deselection_of_arm_var_variable_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_t_summary_by | 👶 | | $+18.88$ | e2e_tm_t_summary_by_Deselection_of_arm_var_variable_throws_validation_error. | | shinytest2-tm_t_summary_by | 👶 | | $+8.83$ | e2e_tm_t_summary_by_Deselection_of_summarize_vars_variable_throws_validation_error. | | shinytest2-tm_t_summary_by | 👶 | | $+8.11$ | e2e_tm_t_summary_by_Module_initializes_in_teal_without_errors_and_produces_table_output. | | shinytest2-tm_t_summary_by | 👶 | | $+29.51$ | e2e_tm_t_summary_by_Selecting_arm_var_variable_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_t_summary_by | 👶 | | $+9.58$ | e2e_tm_t_summary_by_Selecting_summarize_vars_variable_changes_the_table_and_does_not_throw_validation_errors. | | shinytest2-tm_t_summary_by | 👶 | | $+9.04$ | e2e_tm_t_summary_by_Starts_with_specified_label_arm_var_paramcd_by_vars_summarize_vars_useNA_numeric_stats_add_total_parallel_vars_row_groups_drop_zero_levels. |

Results for commit d7bd4bbb17127bdf4c303cac84b35cee1945c7ff

♻️ This comment has been updated with latest results.