[Question]: How does triton avoid lds bank conflict? - Githubissues

ROCm / triton

Development repository for the Triton language and compiler

MIT License

96 stars 29 forks source link

[Question]: How does triton avoid lds bank conflict? #667

Closed LeiWang1999 closed 3 days ago

LeiWang1999 commented 4 days ago

Problem Description

Thank you for all the incredible work on this amazing project!

I was surprised to discover that Triton GEMM on ROCm is also conflict-free. Did we use padding or XOR-based swizzling to avoid bank conflicts?

I’m super curious how this solution is implemented! Where can I find more details on this? Thanks in advance!

Operating System

Ubuntu 22.04

CPU

AMD

GPU

MI300X

ROCm Version

ROCm 6.2.2

ROCm Component

No response

Steps to Reproduce

No response

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

No response

Additional Information

No response

LeiWang1999 commented 3 days ago

I've found related codes, thanks for your awesome solution, and also some discussions at #635.

thanks @zhanglx13 for your patient response :)