Tunning parameters + user arguments - Githubissues

network-analytics / udp-notif-c-collector

UDP-notif protocol c-collector

Other

5 stars 2 forks source link

Tunning parameters + user arguments #32

Open ahuangfeng opened 3 years ago

ahuangfeng commented 3 years ago

Parameters to test and define :

unyte.h: DEFAULT_VLEN
input_queue buffer size / output_queue size
(MTU, message size)
Number of threads parsers

Cleanup+segmentation

segmentation_buffer.h: SIZE_BUFF, CLEAN_UP_PASS_SIZE, CLEAN_COUNT_MAX
listening_worker.h : CLEANUP_FLAG_CRON 1000 // milliseconds

Later

malloc vs tcmalloc vs jemalloc vs unyte_malloc
Linux kernel: buffer of the socket UDP of the kernel

ahuangfeng commented 3 years ago

Find packet loss origin (client_sample vs kernel buffer vs unyte-lib)
parametrized parameters from user
scripts for performance tests

ahuangfeng commented 3 years ago

Quick changes:

QUEUE_SIZE set to 5000 (to avoid parser input queue bottleneck)
Now bottleneck is on client_sample (multithreading works ?)

ahuangfeng commented 3 years ago

Socket buffer should be a argument too

ahuangfeng commented 3 years ago

[x] VLEN
[x] nb_parsers
[x] parser queue size
[x] output queue size
[x] udp socket buffer size
[ ] CLEANUP_FLAG_CRON
[ ] CLEAN_UP_PASS_SIZE
[ ] CLEAN_COUNT_MAX
[ ] SIZE_BUFF

ahuangfeng commented 3 years ago

https://github.com/insa-unyte/udp-notif-c-collector/pull/50 VLEN, nb parsers queue sizes and udp socket size are added as arguments