search

ROCm / MIOpen

AMD's Machine Intelligence Library
https://rocm.docs.amd.com/projects/MIOpen/en/latest/
Other
1.05k stars 219 forks source link

Reproduce kernel cache binary files in MIOpen #2955

Open xuantengh opened 4 months ago

xuantengh commented 4 months ago

Hi MIOpen developers,

There is a team intended to ship MIOpen to Debian's official repository and has made some progress. We notice that there exist some binary files like src/kernels/*.kdb.bz2 used as the kernel cache to avoid runtime JIT when the kernel is first invoked, tracked as either normal Git files or LFS refs based on their sizes. However, it seems that these files are maintained in an opaque way, where the engineers upload without extra explanation #2859, which is not compatible with DFSG requiring source code when distributing the package.

So our question is: can we rebuild/reproduce these binary files locally when compiling MIOpen? This allows us to bring MIOpen in the main archive is the package repository. Otherwise, we may choose to exclude all the binary files at the expense of user performance.

Same problem comes for the src/kernels/*.inc assembly codes, which are uploaded likewisely #2778, #1968. As they're thousands of lines, are they disassembled from some other artifacts?

Looking forward to your replay. Thanks!

atamazov commented 4 months ago

@Huangxt57

Same problem comes for the src/kernels/*.inc assembly codes

FYI The most of those have been generated by an open-source generator, https://github.com/ROCm/MISA.