TensorRT - TensorRT - Complete RoPE & repeat_KV implementation. - Githubissues

tloen / alpaca-lora

Instruct-tune LLaMA on consumer hardware

Apache License 2.0

18.68k stars 2.22k forks source link

TensorRT - TensorRT - Complete RoPE & repeat_KV implementation. #616

Open HengJayWang opened 10 months ago

HengJayWang commented 10 months ago

TensorRT - TensorRT - Complete RoPE & repeat_KV implementation.