search

triton-inference-server / fastertransformer_backend

BSD 3-Clause "New" or "Revised" License
411 stars 133 forks source link

Free buffer forward pass Llama #174

Closed sfc-gh-ybsat closed 10 months ago