rahlk / Antara

GNU General Public License v3.0
0 stars 0 forks source link

Results - II #14

Open rahlk opened 4 years ago

rahlk commented 4 years ago

Readelf 2.34 (different pairs of inputs)

+--------+---------------+---------------+---------------+----------------+----------------+
|   Seed |   Acc (Top 1) |   Acc (Top 3) |   Acc (Top 5) |   Acc (Top 10) |   Acc (Top 20) |
+--------+---------------+---------------+---------------+----------------+----------------+
|      0 |          7    |         16    |         28    |          34    |          50    |
+--------+---------------+---------------+---------------+----------------+----------------+
|      1 |          1.89 |          5.66 |          7.55 |          15.09 |          33.02 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      2 |         12.84 |         19.27 |         23.85 |          30.28 |          41.28 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      3 |         12.84 |         19.27 |         22.94 |          31.19 |          46.79 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      4 |         18.35 |         27.52 |         32.11 |          38.53 |          51.38 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      5 |         19.09 |         33.64 |         38.18 |          42.73 |          48.18 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      6 |         17.27 |         31.82 |         38.18 |          42.73 |          52.73 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      7 |         16.36 |         24.55 |         30    |          39.09 |          49.09 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      8 |         58.93 |         69.64 |         71.43 |          75.89 |          80.36 |
+--------+---------------+---------------+---------------+----------------+----------------+
|      9 |         55.36 |         62.5  |         69.64 |          80.36 |          85.71 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     10 |         54.46 |         62.5  |         73.21 |          81.25 |          84.82 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     11 |         59.82 |         66.96 |         73.21 |          77.68 |          83.04 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     12 |         59.82 |         67.86 |         72.32 |          79.46 |          85.71 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     13 |         58.93 |         68.75 |         70.54 |          78.57 |          86.61 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     14 |         58.93 |         70.54 |         72.32 |          82.14 |          88.39 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     15 |         58.04 |         66.07 |         70.54 |          74.11 |          84.82 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     16 |         62.5  |         71.43 |         76.79 |          83.04 |          87.5  |
+--------+---------------+---------------+---------------+----------------+----------------+
|     17 |         58.93 |         67.86 |         75    |          80.36 |          87.5  |
+--------+---------------+---------------+---------------+----------------+----------------+
|     18 |         81.25 |         90.18 |         92.86 |          93.75 |          94.64 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     19 |         82.14 |         89.29 |         91.96 |          92.86 |          93.75 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     20 |         83.93 |         91.07 |         93.75 |          95.54 |          95.54 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     21 |         81.25 |         89.29 |         91.96 |          93.75 |          94.64 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     22 |         83.04 |         88.39 |         91.96 |          94.64 |          94.64 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     23 |         73.21 |         82.14 |         87.5  |          89.29 |          90.18 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     24 |         72.32 |         82.14 |         83.93 |          88.39 |          91.96 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     25 |         69.03 |         75.22 |         81.42 |          86.73 |          87.61 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     26 |         69.03 |         76.11 |         80.53 |          86.73 |          88.5  |
+--------+---------------+---------------+---------------+----------------+----------------+
|     27 |         65.49 |         73.45 |         81.42 |          85.84 |          88.5  |
+--------+---------------+---------------+---------------+----------------+----------------+
|     28 |         70.8  |         81.42 |         84.07 |          86.73 |          87.61 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     29 |         67.26 |         76.11 |         78.76 |          87.61 |          88.5  |
+--------+---------------+---------------+---------------+----------------+----------------+
|     30 |         64.6  |         72.57 |         79.65 |          84.07 |          86.73 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     31 |         68.14 |         76.99 |         80.53 |          84.96 |          89.38 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     32 |         71.93 |         78.07 |         81.58 |          87.72 |          88.6  |
+--------+---------------+---------------+---------------+----------------+----------------+
|     33 |         70.18 |         79.82 |         84.21 |          88.6  |          90.35 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     34 |         72.81 |         78.95 |         82.46 |          88.6  |          89.47 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     35 |         71.93 |         78.95 |         80.7  |          87.72 |          89.47 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     36 |         74.56 |         81.58 |         84.21 |          85.96 |          89.47 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     37 |         67.54 |         77.19 |         81.58 |          86.84 |          88.6  |
+--------+---------------+---------------+---------------+----------------+----------------+
|     38 |         17.39 |         25.22 |         33.91 |          42.61 |          54.78 |
+--------+---------------+---------------+---------------+----------------+----------------+
|     39 |         28.7  |         38.26 |         43.48 |          59.13 |          67.83 |
+--------+---------------+---------------+---------------+----------------+----------------+

Readelf 2.32 vs 2.34 (same inputs)

+------+-------------+-------------+-------------+--------------+--------------+
| Seed | Acc (Top 1) | Acc (Top 3) | Acc (Top 5) | Acc (Top 10) | Acc (Top 20) |
+------+-------------+-------------+-------------+--------------+--------------+
| 0    | 44.76       | 62.86       | 70.48       | 76.19        | 81.9         |
+------+-------------+-------------+-------------+--------------+--------------+
| 1    | 51.4        | 61.68       | 67.29       | 73.83        | 83.18        |
+------+-------------+-------------+-------------+--------------+--------------+
| 2    | 54.55       | 65.45       | 69.09       | 78.18        | 80.0         |
+------+-------------+-------------+-------------+--------------+--------------+
| 3    | 44.55       | 58.18       | 65.45       | 73.64        | 76.36        |
+------+-------------+-------------+-------------+--------------+--------------+
| 4    | 56.25       | 64.29       | 70.54       | 75.89        | 80.36        |
+------+-------------+-------------+-------------+--------------+--------------+
| 5    | 59.82       | 71.43       | 75.89       | 79.46        | 83.93        |
+------+-------------+-------------+-------------+--------------+--------------+
| 6    | 57.14       | 70.54       | 75.0        | 79.46        | 82.14        |
+------+-------------+-------------+-------------+--------------+--------------+
| 7    | 53.57       | 65.18       | 67.86       | 75.0         | 80.36        |
+------+-------------+-------------+-------------+--------------+--------------+
| 8    | 61.61       | 72.32       | 78.57       | 80.36        | 82.14        |
+------+-------------+-------------+-------------+--------------+--------------+
| 9    | 57.52       | 70.8        | 73.45       | 77.88        | 80.53        |
+------+-------------+-------------+-------------+--------------+--------------+
| 10   | 54.87       | 69.91       | 75.22       | 79.65        | 82.3         |
+------+-------------+-------------+-------------+--------------+--------------+
| 11   | 58.41       | 69.91       | 76.11       | 80.53        | 84.07        |
+------+-------------+-------------+-------------+--------------+--------------+
| 12   | 56.64       | 69.91       | 76.11       | 78.76        | 81.42        |
+------+-------------+-------------+-------------+--------------+--------------+
| 13   | 61.06       | 73.45       | 75.22       | 78.76        | 86.73        |
+------+-------------+-------------+-------------+--------------+--------------+
| 14   | 58.41       | 69.03       | 74.34       | 76.11        | 79.65        |
+------+-------------+-------------+-------------+--------------+--------------+
| 15   | 58.41       | 71.68       | 74.34       | 76.11        | 82.3         |
+------+-------------+-------------+-------------+--------------+--------------+
| 16   | 54.87       | 67.26       | 69.91       | 76.11        | 82.3         |
+------+-------------+-------------+-------------+--------------+--------------+
| 17   | 53.98       | 69.91       | 76.99       | 79.65        | 84.96        |
+------+-------------+-------------+-------------+--------------+--------------+
| 18   | 56.14       | 71.05       | 74.56       | 81.58        | 83.33        |
+------+-------------+-------------+-------------+--------------+--------------+
| 19   | 54.39       | 67.54       | 76.32       | 78.95        | 83.33        |
+------+-------------+-------------+-------------+--------------+--------------+
| 20   | 50.88       | 64.04       | 69.3        | 75.44        | 82.46        |
+------+-------------+-------------+-------------+--------------+--------------+
| 21   | 50.88       | 68.42       | 73.68       | 78.07        | 80.7         |
+------+-------------+-------------+-------------+--------------+--------------+
| 22   | 54.39       | 64.91       | 72.81       | 78.95        | 81.58        |
+------+-------------+-------------+-------------+--------------+--------------+
| 23   | 47.37       | 64.91       | 71.93       | 77.19        | 79.82        |
+------+-------------+-------------+-------------+--------------+--------------+
| 24   | 49.12       | 66.67       | 72.81       | 77.19        | 83.33        |
+------+-------------+-------------+-------------+--------------+--------------+
| 25   | 50.88       | 62.28       | 68.42       | 73.68        | 80.7         |
+------+-------------+-------------+-------------+--------------+--------------+
| 26   | 50.0        | 60.53       | 65.79       | 73.68        | 79.82        |
+------+-------------+-------------+-------------+--------------+--------------+
| 27   | 50.88       | 63.16       | 66.67       | 73.68        | 80.7         |
+------+-------------+-------------+-------------+--------------+--------------+
| 28   | 52.63       | 60.53       | 68.42       | 77.19        | 83.33        |
+------+-------------+-------------+-------------+--------------+--------------+
| 29   | 56.14       | 64.04       | 70.18       | 76.32        | 81.58        |
+------+-------------+-------------+-------------+--------------+--------------+
| 30   | 49.12       | 60.53       | 66.67       | 72.81        | 77.19        |
+------+-------------+-------------+-------------+--------------+--------------+
| 31   | 52.63       | 67.54       | 71.05       | 78.95        | 81.58        |
+------+-------------+-------------+-------------+--------------+--------------+
| 32   | 51.75       | 65.79       | 70.18       | 76.32        | 81.58        |
+------+-------------+-------------+-------------+--------------+--------------+
| 33   | 57.02       | 68.42       | 72.81       | 77.19        | 84.21        |
+------+-------------+-------------+-------------+--------------+--------------+
| 34   | 50.88       | 64.04       | 69.3        | 77.19        | 80.7         |
+------+-------------+-------------+-------------+--------------+--------------+
| 35   | 51.75       | 63.16       | 71.93       | 78.95        | 83.33        |
+------+-------------+-------------+-------------+--------------+--------------+
| 36   | 50.88       | 64.04       | 66.67       | 72.81        | 80.7         |
+------+-------------+-------------+-------------+--------------+--------------+
| 37   | 47.37       | 57.89       | 64.04       | 72.81        | 78.07        |
+------+-------------+-------------+-------------+--------------+--------------+
| 38   | 52.63       | 64.04       | 70.18       | 78.95        | 83.33        |
+------+-------------+-------------+-------------+--------------+--------------+
| 39   | 56.14       | 67.54       | 72.81       | 75.44        | 79.82        |
+------+-------------+-------------+-------------+--------------+--------------+