search

eMoflon / benchmarx

Infrastructure for implementing benchmarx: benchmarks for bidirectional transformation (bx) tools. Also contains a collection of example benchmarx and test runners for various and diverse bx tools.
GNU General Public License v3.0
9 stars 12 forks source link

How to generate the same result in "Benchmarking bidirectional transformations: theory, implementation, application, and assessment", especially the figures? #77

Closed Stevengre closed 1 year ago

Stevengre commented 1 year ago

How to generate Table 5, Fig.26, Fig.27, Fig.28, Fig.29 step by step?

anthonyanjorin commented 1 year ago

Hi @Stevengre,

creating the final plots requires some manual work with a plotting program (we used Google Sheets for this).

The values for the plots can be generated by running the benchmark.

The easiest would be for me to create a suitable tag and get back to you ASAP. A few solutions were not fully integrated into the benchmark infrastructure and require a few extra steps (I’ll document this too if this is not already in the code).

Cheers, Tony

Stevengre commented 1 year ago

Hi @anthonyanjorin,

I wanted to express my gratitude for your generous help. I am eagerly waiting for your update on the problem. In the meantime, I am going to attempt constructing a new BX implementation based on my framework. My hope is that the code will generate a csv or excel file with the conformance/performance results, allowing me to easily obtain the same table/figure for my framework optimization.

Thank you again for your assistance.

Best regards, Jianhong

anthonyanjorin commented 1 year ago

Hi @Stevengre,

the current main branch (not master!) can be used to generate the measurement data used for our paper (see your other issue #76). If you have any questions or encounter problems, please don't hesitate to reach out again.

Cheers, Tony

FYI: @tbuchmann