search

Rust-GPU / Rust-CUDA

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.
Apache License 2.0
2.97k stars 112 forks source link

Is it possible to launch multiple kernels of the same type at once? #107

Closed jayavanth closed 1 year ago

jayavanth commented 1 year ago

I want to launch N kernels of the same type at once. How should I go about this? Should I create multiple Programs or just one Program but multiple kernels?

RDambrosio016 commented 1 year ago

Launching them back to back without synchronizing the stream, or launching on separate streams then synchronizing should be fast enough, since the launch is non-blocking.