NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
https://developer.nvidia.com/tensorrt
Apache License 2.0
10.57k stars 2.1k forks source link

demo in demo/difuusion,support lora and contorlnet? #3680

Closed henbucuoshanghai closed 4 months ago

henbucuoshanghai commented 6 months ago

demo /Diffusion/

zerollzeng commented 6 months ago

@rajeevsrao ^ ^

henbucuoshanghai commented 6 months ago

how to load my onw llm?like chillout or anything?in demo/diffusion

ttyio commented 4 months ago

@henbucuoshanghai could you check the source code see how the onnx is exported and trt engine is built from those onnx? thanks!