cmu-db / peloton

The Self-Driving Database Management System
http://pelotondb.io
Apache License 2.0
2.03k stars 624 forks source link

Peloton-benchmark performs worse than "weaker" machines #1437

Closed lmwnshn closed 6 years ago

lmwnshn commented 6 years ago

Summary Benchmark machine has faster CPUs, more CPUs, more memory, but still performs worse on YCSB.

Details

Disk space doesn't appear to be an issue.

Tried without success

  1. Disabling cores on the benchmark machine to also have 8 cores.

This is with a custom branch from @pervazea , however, there's generally been a trend of the benchmark machine reporting poorer numbers.

tli2 commented 6 years ago

Maybe this has to do with high contention somewhere in our code?

lmwnshn commented 6 years ago

That's part of why we tried disabling the cores, but no luck.

mbutrovich commented 6 years ago

If this is single terminal (1 thread), I'm not surprised to see a 6 year-old Sandy Bridge @ 2.2GHz (turbo up to 3.0GHz) getting beaten by a brand new Kaby Lake @ 1.8GHz (turbo up to 4.0GHz) in single-threaded performance, even if the former is a server CPU and the latter is mobile.

The turbo frequency difference alone should explain the difference, but on top of that Intel makes regular IPC improvements with each microarchitecture.