SKA-ScienceDataProcessor / integration-prototype

SDP Integration Prototype

BSD 3-Clause "New" or "Revised" License

4 stars 7 forks source link

Add initial multi-threaded C receiver #80

Closed fdulwich closed 5 years ago

fdulwich commented 5 years ago

Description:

TSK-2747 Add initial multi-threaded C receiver test.

TSK-2745 Add Dockerfile for building the C receiver's container.

TSK-2746 Add Docker Compose files for running locally and on P3, and README.md to describe how to run the test and report test results.

Changed sender to wait until the start of the next half-minute, to allow for synchronisation.

Testing instructions:

See the README.md file inside the recv_c sub-directory.

Types of changes

[ ] Bug fix (non-breaking change that fixes an issue)
[x] New feature (non-breaking change that adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to change)

codecov[bot] commented 5 years ago

Codecov Report

Merging #80 into master will not change coverage. The diff coverage is n/a.

@@           Coverage Diff           @@
##           master      #80   +/-   ##
=======================================
  Coverage   86.07%   86.07%           
=======================================
  Files          59       59           
  Lines        2671     2671           
  Branches      221      221           
=======================================
  Hits         2299     2299           
  Misses        321      321           
  Partials       51       51

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 3987c4b...efade2e. Read the comment docs.

scpmw commented 5 years ago

So the new value is 2.9 GB/s per node? That makes around 160 nodes for our ingest rate, sounds plausible.

Now the question is how much of that we could get from Python I guess? :)