Closed dyastremsky closed 2 months ago
@rmccorm4: The flag for Triton import command hasn't changed
Ah, right. Yeah I don't think this needs to change
I made the latest changes to this doc/branch and I was pretty sure I tested everything worked, that's why I was a little surprised at this PR.
Thanks for catching this! It threw me off that the arg was different between the two. Closing this PR.
The
trtllm
backend was renamed totensorrtllm
after the 24.04 release. We need to update it in one more place.