search

ROCm / triton

Development repository for the Triton language and compiler
MIT License
80 stars 22 forks source link

Merge changes according to AOTriton's testing results. #518

Open xinyazhang opened 4 months ago

xinyazhang commented 4 months ago

Major changes:

  1. Fix some memory accessing problems
  2. Fix dropout support (mainly RETURN_ENCODED_SOFTMAX)
  3. Reorder/rename some arguments
  4. Rename some variables
  5. Remove unused/duplicated variables.
  6. Remove use_bias from test_op_fwd and replace it's functionality with bias_type = None

All tests from pytest flash-attention.py -k 'test_op_fwd passed