Check if the channel capacities fit the available JVM memory

[iariasleon]

The idea is to check if the channel capacicities fit the available memory in the JVM, and in case they don't fit, to adjust them.

test Nº 1

cygnus.conf (default)

# capacity of the channel
cygnusagent.channels.ckan-channel.capacity = 1000  
# amount of bytes that can be sent per transaction
cygnusagent.channels.ckan-channel.transactionCapacity = 100 

result:

summary +    220 in  16.3s =   13.5/s Avg:  2462 Min:    60 Max:  3019 Err:     6 (2.73%) Active: 0 Started: 50 Finished: 50
summary =   6154 in   310s =   19.9/s Avg:  2443 Min:    14 Max:  3037 Err:   214 (3.48%)

test Nº 2

cygnus.conf

# capacity of the channel
cygnusagent.channels.ckan-channel.capacity = 10000
# amount of bytes that can be sent per transaction
cygnusagent.channels.ckan-channel.transactionCapacity = 1000 

result:

summary +    187 in  14.4s =   13.0/s Avg:  2327 Min:    62 Max:  3017 Err:     3 (1.60%) Active: 0 Started: 50 Finished: 50
summary =  15061 in   310s =   48.6/s Avg:   997 Min:    14 Max:  3317 Err:   480 (3.19%)

test Nº 3

cygnus.conf

# capacity of the channel
cygnusagent.channels.ckan-channel.capacity = 1000000
# amount of bytes that can be sent per transaction
cygnusagent.channels.ckan-channel.transactionCapacity = 10000

result:

summary +    618 in     2s =  318.9/s Avg:    15 Min:    14 Max:    20 Err:     0 (0.00%) Active: 0 Started: 50 Finished: 50
summary = 119039 in   110s = 1084.6/s Avg:    40 Min:    14 Max:   674 Err:     0 (0.00%)

Effort: 1 man day

[frbattid]

Related to https://github.com/telefonicaid/fiware-cygnus/issues/252