Xilinx / inference-server

https://xilinx.github.io/inference-server/
Apache License 2.0
43 stars 13 forks source link

Error starting server from Python package #224

Closed sitabulaixizawaluduo closed 7 months ago

sitabulaixizawaluduo commented 8 months ago

python: server = amdinfer.Server() RuntimeError: basic_string::_S_construct null not valid

i installed amdinfer by command pip install amdinfer

varunsh-xilinx commented 7 months ago

The Python package on pip is primarily for the client library, which should be usable in any environment. However, it won't let you start the server unless you're using the development container. In this case, you can look at the developer quickstart. The error message here should be better though.

Otherwise, you'd need to run a deployment container to launch the server. Take a look at the regular quickstart online to get started.

sitabulaixizawaluduo commented 7 months ago

The Python package on pip is primarily for the client library, which should be usable in any environment. However, it won't let you start the server unless you're using the development container. In this case, you can look at the developer quickstart. The error message here should be better though.

Otherwise, you'd need to run a deployment container to launch the server. Take a look at the regular quickstart online to get started.

thanks!!