search

Shopify / yjit-metrics

"Tasks for benchmarking, building and collecting stats for YJIT"
MIT License
14 stars 9 forks source link

Upgrade AWS Graviton instance #221

Closed maximecb closed 1 month ago

maximecb commented 10 months ago

The ARM instance we currently use to benchmark on AWS is a Graviton 1, which is quite antiquated.

@DazWorrall suggests that there are newer Graviton instances that we could use for benchmarking on ARM, such as m7g.metal, which uses a 3rd generation Graviton chip.

guikcd commented 1 month ago

What instance type has been used to run these benchmarks? I need to POC for a project and I've started to run my own benchmarks on ruby 3.3.5 to compare c5, c6g and c7g.xlarge instance.

maximecb commented 1 month ago

@guikcd can you provide more context on what you mean by POC and which benchmarks you need to run?

rwstauner commented 1 month ago

Current benchmarks have been taken with

arthurpetitpierre commented 1 month ago

For you information, running on metal instances on AWS has very limited impact, if at all, on the performance. Metal instances are only really required if you want to run your own virtualization layer or if you want to access some of the performance counters that are not exposed on virtualized instances. See https://aws.amazon.com/blogs/hpc/bare-metal-performance-with-the-aws-nitro-system/ for more details.

rwstauner commented 3 weeks ago

Thanks @arthurpetitpierre. We do look at perf counters sometimes. We also configure several CPU settings (performance scaling governor, etc) when they are available (Intel metal instances).