search

amirzandieh / HyperAttention

Triton Implementation of HyperAttention Algorithm
Apache License 2.0
46 stars 1 forks source link

added a new mode of operation for sort lsh which instead of approxima… #2

Closed amirzandieh closed 9 months ago

amirzandieh commented 9 months ago

new feature to capture the large entries via a banded diagonal matrix instead of a block diagonal one

amirzandieh commented 9 months ago

👍