Fix triton multi threading when using the C++ stage - Githubissues

nv-morpheus / Morpheus

Morpheus SDK

Apache License 2.0

347 stars 130 forks source link

Fix triton multi threading when using the C++ stage #1739

Closed mdemoret-nv closed 3 months ago

mdemoret-nv commented 3 months ago

Description

In 24.03, multi threading had to be disabled in the Triton C++ stage due to a race condition.
This PR changes the client to use fiber local storage so multiple fibers can be running with different clients at the same time
Allows increasing the pe_count of the stage beyond 1

By Submitting this PR I confirm:

I am familiar with the Contributing Guidelines.
When the PR is ready for review, new or existing tests cover these changes.
When the PR is ready for review, the documentation is up to date with these changes.

dagardner-nv commented 3 months ago

/merge