NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
Hi, does the currently transferred trt engine support flash focus2 by default? If it is not supported by default, how should I use fa2 in the output engine?
Thanks,
lix19937
commented
3 weeks ago
Hi, does the currently transferred trt engine support flash focus2 by default? If it is not supported by default, how should I use fa2 in the output engine? Thanks,