search

cmu-db / peloton

The Self-Driving Database Management System
http://pelotondb.io
Apache License 2.0
2.03k stars 623 forks source link

[15721] Peloton Self-Driving Infrastructure #1346

Open ChTimTsubasa opened 6 years ago

ChTimTsubasa commented 6 years ago

This PR is working toward an infrastructure for self-driving components on Peloton.

In this checkpoint, we presented:

  1. A brand new framework for stats collections. 2, Based on the new framework we collected 1) query metrics measuring latency for queries. 2) table metrics measuring operations count on a specific table, memory usage and memory allocation for both inline data and varlen data 3) index metrics measuring operations count on a specific index, estimated memory usage and memory allocation stats.

To do: Update metrics on catalog

ChTimTsubasa commented 6 years ago

This is not going to add much overhead to the engine as the collector would not be blocked. Actually, the blocking thing is the background aggregating thread as it is CAS on the safe_ flag.

We would like the test the overhead with some TPCC testbench but it seems that the master branch is running slow. We would definitely run TPCC if we get fast enough later, and we claim it's not going to be hard (just change the stats_mode would switch the collection from on/off).

ChTimTsubasa commented 6 years ago

Test cases for the framework are added in stats_framework_test.cpp