sstadick / gzp

Multi-threaded Compression
The Unlicense
156 stars 14 forks source link

GPU-Compression #9

Open deeprobin opened 3 years ago

deeprobin commented 3 years ago

It might be useful when its larger than a specific size to compress the data on the graphics card if available.

sstadick commented 3 years ago

This would be cool! Are you aware of any existing crates for this? I haven't seen / know much about gpu based compression.

deeprobin commented 3 years ago

@sstadick The advantage of compression on the GPU would be that it is probably easier to parallelize the compression here than on a CPU. It is important to pay attention to the GPU overhead and therefore it only makes sense to outsource the compression to the GPU from a certain input size. One possibility would be to exclude the standard library using #![no_std] and compile the code on the NVIDIA target. In my opinion, the optimal solution would be to use OpenCL (e.g. using ocl, opencl3 or others), for example.

See also: