ROCm / rocprofiler-compute

Advanced Profiling and Analytics for AMD Hardware
https://rocm.docs.amd.com/projects/omniperf/en/latest/
MIT License
135 stars 49 forks source link

Enable Mi300 Roofline #285

Open coleramos425 opened 8 months ago

coleramos425 commented 8 months ago

Is your feature request related to a problem? Please describe. Both national labs, internal customers, and others are asking for a Mi300 based roofline analysis. In v2.0 release this was temporarily disabled.

The microbenchmark has been adjusted with help from @rwvo . However, I still want to stress test the arithmetic intensity calculation and put the model through the wringer with some test applications.

Describe the solution you'd like

  1. Start by working with @nwolfey21 to check in on status. His expertise could help inform any adjustments required on arithmetic intensity
  2. Initial tests on the beta-version, iterate, and adjust
  3. Select test suite and verify results
nwolfey21 commented 8 months ago

Happy to help. Let me know what you need. I'm good at breaking things ;)

skyreflectedinmirrors commented 8 months ago

Add me to this as well. @coleramos425 you want to set something up ?

coleramos425 commented 8 months ago

I'll add you to the meeting @skyreflectedinmirrors

lizamd commented 4 months ago

hi @coleramos425 is mi300 roofline enabled in omniperf? get similar request, thanks!

coleramos425 commented 4 months ago

@lizamd we're still developing roofline support. If you ping me on Teams I can provide more detail.

lizamd commented 4 months ago

cool, thanks for the quick response, will ping you!

itej89 commented 3 months ago

Hi @coleramos425, I am also trying to use roofline for bench-marking llama.cpp. Any workarounds or temporary solutions to get it to work would be of great help. Thanks in advance!!

coleramos425 commented 2 months ago

Update 8/16

Just received a beta version of microbenchmark from Rene. @cfallows-amd will be working to validate that work while myself and others work on adjustments to the arithmetic intensity calculation