cmu-db / peloton

The Self-Driving Database Management System
http://pelotondb.io
Apache License 2.0
2.03k stars 623 forks source link

Benchmarking observations #1355

Open pervazea opened 6 years ago

pervazea commented 6 years ago

Recording some observations, that will need resolution (at some point).

  1. Running TPCC. Sometimes (not often, maybe 1 in 10 or 1 in 20 runs), peloton crashes with memory corruption. I suspect this is not TPCC specific.

  2. Result variability. Getting a significant amount of variability in the results. Low around 17, high around 45 and median of around 30 requests / sec. Have not applied any special settings in running the benchmarks.