Network stats and process/constructs ignoring

[Cerfoglg]

fixes #61, fixes #58, fixes #56, fixes #54, fixes #3

Todos:

• [x] https://www.codacy.com/app/BenchFlow/data-transformers/pullRequest?prid=250919

• [x]  File: data-transformers/transformers/mysqlTransformer.py:L165-190
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> Why query.take(2000)?
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme Mistake, fixing it
• [x]  File: data-transformers/transformers/mysqlTransformer.py:L165-190
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> Remove lines 177-178. I guess they are test lines.
• [x]  File: data-transformers/transformers/mysqlTransformer.py:L165-190
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> How are you sure you first compute conf["dest_table"] == "process"? This would be the only case in which you actually have cutProcesses with the correct value.
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme Well, in this case you have to have the configuration with the process table transformation before the construct one.
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> You cannot do this assumption, just get the configuration you need in the order you need from the file without assuming they are in the order process, construct
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme Imposing an order then
• [x]  File: data-transformers/transformers/mysqlTransformer.py:L165-190
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> Remove
• [x]  File: data-transformers/transformers/statsTransformer.py:L127-173
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> What are you doing here? It seems like you are summing the different datapoint you have. Where do you filter out the PIDS that are not belonging to the container?
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme I do it in getBytesSum
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> getBytesSum --> getBytesSumForContainerPIDS
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> You did not answer to: What are you doing here?
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> Basically, for every block (starts with "Refreshing" and lists a bunch of processes doing stuff), it sums the received and sent bytes of all of them, but skipping those who are not in PIDS, meaning we ignore those not from the observed container.
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> Change the name: getBytesSum --> getBytesSumForContainerPIDS
• [x]  File: data-transformers/transformers/statsTransformer.py:L218-263
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> Why an if it is not suitable for this check?
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme I'll alter it then
• [x]  File: data-transformers/transformers/statsTransformer.py:L218-263
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> This block is the same as the one in the else part of the statement. You can place it after the if..else block then.
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme Alright
• [x]  General Comment
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme Fixed things
• <img border=0 src='https://avatars.githubusercontent.com/u/7163641?v=3' height=16 width=16'> @Cerfoglg at the top you find the remaining todos
• <img border=0 src='https://avatars.githubusercontent.com/u/8819678?v=3' height=16 width=16'> @VincenzoFerme All sorted

  

[Cerfoglg]

@VincenzoFerme Fixed things

[VincenzoFerme]

@Cerfoglg at the top you find the remaining todos

[Cerfoglg]

@VincenzoFerme All sorted

[VincenzoFerme]

:+1: