search

gvanhoy / gr-torchdsp

GNU Radio blocks using libtorch C++ API
2 stars 1 forks source link

Include basic installation documentation for TIS #7

Open gvanhoy opened 2 years ago

gvanhoy commented 2 years ago

Triton Inference Server can run in a container, so I just need to include the command to run that gets it started, but this OOT needs to be compiled/linked with the TIS client libraries.

gvanhoy commented 2 years ago

I can include a Dockerfile that does a multi-stage build that copies the Triton Client libraries. They're annoying to deal with because they require the latest CMake, so it's better to just copy the relatively small static/dynamic binaries even for builds outside of Docker. The Dockerfile will just serve as directions on how to build with a clean Ubuntu system. I will include a script that downloads the Triton Client libraries from a docker container. This does make docker technically a requirement for the project, but I guess you could copy the libraries from any machine to another.