search

DARMA-tasking / vt

DARMA/vt => Virtual Transport
Other
35 stars 8 forks source link

Investigate issues with `Build statistics` pipeline #2211

Closed JacobDomagala closed 9 months ago

JacobDomagala commented 10 months ago

Current output: 

AttributeError: 'DataFrame' object has no attribute 'append'. Did you mean: '_append'?
Test files /github/workspace/build/vt/tests/test_make_runnable_micro_time.csv /github/workspace/build/vt/tests/test_make_runnable_micro_mem.csv for test: test_make_runnable_micro
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
Test files /github/workspace/build/vt/tests/test_ping_pong_am_time.csv /github/workspace/build/vt/tests/test_ping_pong_am_mem.csv for test: test_ping_pong_am
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
Test files /github/workspace/build/vt/tests/test_reduce_time.csv /github/workspace/build/vt/tests/test_reduce_mem.csv for test: test_reduce
/generate_perf_graph.py:67: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  current["run_num"] = [new_run_num for node in range(num_nodes)]
/generate_perf_graph.py:68: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  current["date"] = [new_date for node in range(num_nodes)]
/generate_perf_graph.py:69: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame.
Try using .loc[row_indexer,col_indexer] = value instead

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  current["commit"] = [commit_id for node in range(num_nodes)]
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 70, in prepare_data
    current = total_df.append(current)
  File "/usr/local/lib/python3.10/dist-packages/pandas/core/generic.py", line 6204, in __getattr__
Memory: [            name  node       mem
101  test_reduce     0  20460330
102  test_reduce     0  20460330
103  test_reduce     0  20460330
104  test_reduce     0  20460330
105  test_reduce     0  20460330
..           ...   ...       ...
197  test_reduce     0  20486545
198  test_reduce     0  20486545
199  test_reduce     0  20486545
200  test_reduce     0  20486545
201  test_reduce     0  20486545

[101 rows x 3 columns],             name  node       mem
0    test_reduce     1  20152312
1    test_reduce     1  20152312
2    test_reduce     1  20152312
3    test_reduce     1  20152312
4    test_reduce     1  20152312
..           ...   ...       ...
96   test_reduce     1  20171973
97   test_reduce     1  20178527
98   test_reduce     1  20178527
99   test_reduce     1  20178527
100  test_reduce     1  20178527

[101 rows x 3 columns]]
    return object.__getattribute__(self, name)
AttributeError: 'DataFrame' object has no attribute 'append'. Did you mean: '_append'?
Test files /github/workspace/build/vt/tests/test_collection_local_send_preallocate_time.csv /github/workspace/build/vt/tests/test_collection_local_send_preallocate_mem.csv for test: test_collection_local_send_preallocate
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
Test files /github/workspace/build/vt/tests/test_collection_local_send_time.csv /github/workspace/build/vt/tests/test_collection_local_send_mem.csv for test: test_collection_local_send
Traceback (most recent call last):
  File "/generate_perf_graph.py", line 234, in <module>
    test_name_in, time_data_in, memory_data_in = prepare_data()
  File "/generate_perf_graph.py", line 45, in prepare_data
    for node in range(num_nodes):
TypeError: 'float' object cannot be interpreted as an integer
/tmp/ci-XJBFHmL3Gl
Traceback (most recent call last):
  File "/generate_wiki_pages.py", line 430, in <module>
    generate_graph(EXP_TEMPLATE_INST_DIR, templates_total_times_in)
  File "/generate_wiki_pages.py", line 180, in generate_graph
    ax_1.grid(b=True, color="grey", linestyle="-.", linewidth=0.5, alpha=0.8)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axes/_base.py", line 3196, in grid
    self.xaxis.grid(visible, which=which, **kwargs)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axis.py", line 1697, in grid
    self.set_tick_params(which='major', **gridkw)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axis.py", line 958, in set_tick_params
    kwtrans = self._translate_tick_params(kwargs)
  File "/usr/local/lib/python3.10/dist-packages/matplotlib/axis.py", line 1102, in _translate_tick_params
    raise ValueError(
ValueError: keyword grid_b is not recognized; valid keywords are ['size', 'width', 'color', 'tickdir', 'pad', 'labelsize', 'labelcolor', 'labelfontfamily', 'zorder', 'gridOn', 'tick1On', 'tick2On', 'label1On', 'label2On', 'length', 'direction', 'left', 'bottom', 'right', 'top', 'labelleft', 'labelbottom', 'labelright', 'labeltop', 'labelrotation', 'grid_agg_filter', 'grid_alpha', 'grid_animated', 'grid_antialiased', 'grid_clip_box', 'grid_clip_on', 'grid_clip_path', 'grid_color', 'grid_dash_capstyle', 'grid_dash_joinstyle', 'grid_dashes', 'grid_data', 'grid_drawstyle', 'grid_figure', 'grid_fillstyle', 'grid_gapcolor', 'grid_gid', 'grid_in_layout', 'grid_label', 'grid_linestyle', 'grid_linewidth', 'grid_marker', 'grid_markeredgecolor', 'grid_markeredgewidth', 'grid_markerfacecolor', 'grid_markerfacecoloralt', 'grid_markersize', 'grid_markevery', 'grid_mouseover', 'grid_path_effects', 'grid_picker', 'grid_pickradius', 'grid_rasterized', 'grid_sketch_params', 'grid_snap', 'grid_solid_capstyle', 'grid_solid_joinstyle', 'grid_transform', 'grid_url', 'grid_visible', 'grid_xdata', 'grid_ydata', 'grid_zorder', 'grid_aa', 'grid_c', 'grid_ds', 'grid_ls', 'grid_lw', 'grid_mec', 'grid_mew', 'grid_mfc', 'grid_mfcalt', 'grid_ms']
JacobDomagala commented 9 months ago

With https://github.com/DARMA-tasking/build-stats/pull/25 merged, the issue is resolved.