AccelerateWithOptane / lab

Request access to Optane powered bare metal infrastructure for performance-testing and analysis purposes
15 stars 3 forks source link

Benchmark of Benchmarks #25

Open mw2q opened 4 years ago

mw2q commented 4 years ago

If you are interested in filing a request for access to the Accelerate With Optane Community Lab for performance testing, optimization, and analysis, please fill out the details below. Contact Avi Deitcher at avi@packet.net with questions.

Name, email, company, job title

Mark Wong, markwkm@postgresql.org, PostgreSQL, Contributor mark@2ndQuadrant.com, 2ndQuadrant, Consultant

Project Title and brief description

Benchmark of Benchmarks

TPC, SSBM, YCSB, are just some of the database benchmarks available. Yet there are many derivatives, implementations, and variations of these and other benchmarks. The differences between them vary between ease of use, and effectiveness at testing at large scales. Efficient tools are important when testing large database systems at the scale of terabytes. This project focuses on identifying which implementations are viable at large scales.

How does the open source community benefit from your work?

Profiling workloads that can drive large systems to its limits help developers find bottlenecks, improve performance and find bugs. This project aims to identify which tools can be used to generate 100GB, or 1TB of data in a reasonable amount of time.

Is the code that you’re going to run 100% open source? If so, what is the URL or URLs where it is located?

Yes:

Does the infrastructure provided meet your testing needs (see: https://www.acceleratewithoptane.com/access/)?

Yes. I am expecting datasets up to 1TB to be sufficient to illustrate to what degree each benchmark implementation is good for.

What performance-focused articles has your project published before?

Please state your contributions to the open source community and any other relevant initiatives

Would you be willing to share your analysis and results publicly?

Yes, all results are intended to be publicly available through blog posts and presentations.

Are you interested in testing Intel Optane SSDs with Intel Memory Drive Technology (IMDT)?

Yes.