Stream data

[kloppstock]

Write functions to stream the data to the GPU.

[bussmann]

Did you put the asynchronous memcopies into individual streams?

[kloppstock]

Every stream calculates a block of images. Therefore every stream does (in order):

• copy data to the pinned memory
• copy data to the GPU
• execute the kernel
• copy data back from the GPU into pinned memory
• copy data back from pinned memory into normal memory

This should allow multiple kernels to work concurrently in different stages.