Message size percentile

[huyba]

Hi,

I need know message size percentile in communication carrying by Thorium i.e. what is max size, min size, average size, sizes that 25%, 50% (median) and 75% number of messages below, to estimate how much benefit we can get from using PAMI and to create buffer size appropriately.

Thanks,

Huy.

[sebhtml]

related: PAMI #453

[sebhtml]

With -enable-transport-profiler:

http://pastebin.com/xjrCyWa2

I checked and the helper functions to compute percentiles don't support frequency distribution right now, only vector of values are supported. So we will need to add that if we want percentiles for buffer sizes.

[sebhtml]

@hubot says: implemented in commit https://github.com/sebhtml/biosal/commit/deecca11b47cfc46a200f57eaaee0636b15ff75f by @sebhtml !

[huyba]

Thanks for the byte count and frequency. I plotted the quadtile and historgram based on your numbers - mainly for fun.

Huy.

On 8/17/14, 5:06 PM, Sébastien Boisvert wrote:

ByteCount Frequency 8 329748 12 249 13 16 16 39 36 4 132 43 335 1 354 2 373 1 411 1 449 2 468 3 487 2 506 6 525 3 544 9 563 1 582 9 601 4 620 8 639 5 658 9 677 8 696 8 715 3 734 7 753 7 772 7 791 3 810 6 829 7 836 5 848 14 867 8 886 12 905 10 924 22 943 24 962 28 981 39 1000 46 1019 72 1032 161851 1038 87 1057 110 1076 160 1095 194 1114 272 1133 295 1152 447 1171 488 1190 757 1209 707 1228 1031 1247 1131 1266 1500 1285 1572 1304 2017 1323 2171 1342 2734 1361 2940 1380 3758 1399 3745 1418 4612 1437 4734 1456 5679 1475 5740 1494 6722 1513 7062 1532 8116 1551 8010 1570 9418 1589 9289 1608 10394 1620 2 1627 10173 1646 11349 1665 11123 1684 12270 1703 11576 1722 12657 1741 11948 1760 12928 1779 11898 1798 12616 1817 11791 1836 12564 1855 11517 1874 11928 1893 10897 1912 11107 1931 10045 1950 10221 1969 9069 1988 8973 2007 7943 2008 257099 2026 7889 2045 7068 2064 6855 2083 6035 2102 5820 2121 5042 2140 4791 2159 4181 2178 3990 2197 3329 2216 3110 2235 2770 2254 2469 2273 2067 2292 1857 2311 1558 2330 1420 2349 1165 2368 1116 2387 860 2406 818 2425 603 2444 550 2463 490 2482 417 2501 313 2520 271 2539 224 2558 189 2577 152 2596 127 2615 98 2634 72 2653 60 2672 55 2691 45 2710 48 2729 29 2748 26 2767 18 2786 14 2805 14 2824 9 2843 8 2862 9 2881 2 2900 4 2919 3 2957 1 2976 1 2995 2 3014 2 3090 1 3109 1 (END) [0] 0:E. coli cool 1:biosal testing ground* 2:biosal 3 3:watch elapsed 4:biosal code 5:tests 6:testing data 7:S3 testing data 8:S3 data 9:automated tests ring log 10:dropbox stuff 11:automated tests tail log 12:manual test 13:root 14:dropbox e coli 15:spate test 16:failure 17:bash 18:zpipe 19:last test 20:bash 21:S aureus 22:tests- "boisvert@bigmem:~/bios" 18:06 17-Aug-14

— Reply to this email directly or view it on GitHub https://github.com/GeneAssembly/biosal/issues/570#issuecomment-52437014.