NVIDIA / TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
https://developer.nvidia.com/tensorrt
Apache License 2.0
10.14k stars 2.08k forks source link

ideas #3944

Open Abidouz opened 2 weeks ago

Abidouz commented 2 weeks ago

Here are some ideas and potential areas of research for Tensort:

lix19937 commented 2 weeks ago

Tensorrt is just a infer engine, according to your ideas, tensorrt should have an embedded llm to drive itself.

adamconrad7 commented 4 days ago

This looks like an LLM generation