search

Jamie-Stirling / RetNet

An implementation of "Retentive Network: A Successor to Transformer for Large Language Models"
MIT License
1.14k stars 99 forks source link

Update src/complex/retention.py #15

Closed MichaelFu1998-create closed 11 months ago

MichaelFu1998-create commented 11 months ago

make "D" and "X" under the same device

MichaelFu1998-create commented 11 months ago

update _get_D function for ./src/complex/retention.py to the one in ./src as discussed in https://github.com/Jamie-Stirling/RetNet/issues/7#issue-1818746826