eth-easl / orion

An interference-aware scheduler for fine-grained GPU sharing
MIT License
79 stars 12 forks source link

Check flags for stream creation #4

Closed fotstrt closed 1 year ago

fotstrt commented 1 year ago

When we create a stream, we need to provide a flag, which can either be cudaStreamDefault or cudaStreamNonBlocking. According to the NVIDIA guide, the difference is on whether the new stream will synchronize with stream 0 or not.

We need to check what to use, and whether it makes any difference.

fotstrt commented 1 year ago

Resolved