search

triton-inference-server / fastertransformer_backend

BSD 3-Clause "New" or "Revised" License
411 stars 133 forks source link

fix fastertransformer build for 23.05+ #158

Closed jbkyang-nvi closed 1 year ago

jbkyang-nvi commented 1 year ago

Fix the build in CMakelists.txt so that build.py and create_dockerfile_and_build.py works for Triton 23.05+

jbkyang-nvi commented 1 year ago

related to https://github.com/triton-inference-server/fastertransformer_backend/pull/153

mshuffett commented 1 year ago

Probably good to update the README with 23.05 and change this NOTE

NOTE: Fastertransformer backend is currently undergoing restructuring. Build instructions are only tested with Triton container versions <= 23.04.