Open Proryanator opened 1 month ago
Nice! This seems roughly on par with the other M3 Max results in the README, but I'll switch to yours since it has the load time too :)
On twitter, we were hypothesizing that memory bandwidth doesn't help ANE like it does GPU (based on the small difference between M3 and M3 Max) but it would definitely be interesting to see M3 Max 300GB/s vs. M3 Max 400GB/s!
Actually, did you happen to see your ANE power usage? (Like in asitop or mactop.) Guessing it will be similar but would rather not mix samples from different computers in the README.
Actually, did you happen to see your ANE power usage? (Like in asitop or mactop.) Guessing it will be similar but would rather not mix samples from different computers in the README.
I can re-run it and check asitop just in case 👍 looks like my macbook was using 5.7W (made sure it was on high power mode):
@Proryanator hey asitop has been abandoned and can report things wrong :( (i would miss it) probably try pumas! But I would test your code on my 16core/64GB variant and report back
asitop, mactop, and pumas all use powermetrics under the covers for ANE, so I believe for the raw Watts we should be safe to compare across tools. (Percentage usage might be a different story.)
Also, worth noting that I have updated the model since this post so it should be faster!
@Proryanator hey asitop has been abandoned and can report things wrong :( (i would miss it) probably try pumas!
But I would test your code on my 16core/64GB variant and report back
Just curious how do you know that it has been abandoned? The list of issues going back a few years?
@Proryanator hey asitop has been abandoned and can report things wrong :( (i would miss it) probably try pumas! But I would test your code on my 16core/64GB variant and report back
Just curious how do you know that it has been abandoned? The list of issues going back a few years?
Because it hasn't been updated for M3 series yet, not even merging the proven fixed pull requests as well. It has been hanging there for a very long time now (last commit was from Jan 2023). ASITOP is purely hard coded for chip models thus when it's wrong, it's very very wrong...
I have an M3 Max 14-core CPU/30-core GPU, with 36GB of RAM (with 300GB/s memory bandwidth). I may know someone who has the 16-core variant that I can reach out to since they will probably have better performance since the higher one has 400GB/s memory bandwidth.