search

nv-morpheus / Morpheus

Morpheus SDK
Apache License 2.0
309 stars 119 forks source link

[BUG]: vdb_upload should not use shared memory #1753

Closed dagardner-nv closed 1 week ago

dagardner-nv commented 1 week ago

Version

24.06

Which installation method(s) does this occur on?

Source

Describe the bug.

The C++ impl of the Triton client doesn't support shared memory, setting this value to True forces usage of the Python impl.

Minimum reproducible example

python examples/llm/main.py vdb_upload pipeline

Relevant log output

Click here to see error details

 [Paste the error here, it will be hidden by default]

Full env printout

Click here to see environment details

 [Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct