Add the FA v2 "varlen" API

ROCm / triton

Development repository for the Triton language and compiler

MIT License

80 stars 23 forks source link

Closed vgokhale closed 5 months ago

vgokhale commented 5 months ago

Currently only supports the v2 API for fwd pass / inference. Causal masking, bias and dropout are not yet supported.