DeepOLA: Experiment Tracker

[nikhil96sher]

Experiment Setup

• [x] Azure VM
• [x] Data Generation: TBL
  • [x] Scale = 50: TPC-H Original Data
  • [x] Scale = 100: TPC-H Original Data
• [x] Data Conversion: Parquet (Both Partition = 1 and Partition = 512M)
  • [x] Scale = 100: TPC-H Original Data
  • [x] Scale = 100: TPC-H Skewed Data
• Things to Remember
  • Important: Disable Cache
  • Mount /data/ in read-only mode if you only need to copy the data.

WAKE

• [x] Implementation: 22 Queries Without Scaling
• [x] Implementation: 22 Queries With Scaling
• [x] Script to set up the repository and run experiments
• [x] Latency Results
  • [x] Scale = 100; Partition = 512M dataset.
  • [ ] Skewed Scale = 100; Partition = 512M dataset.
• [x] Error Results
  • [x] Scale = 100; Partition = 512M dataset.
  • [ ] Skewed Scale = 100; Partition = 512M dataset.
• [x] Variation of Partitions Experiment
• [ ] Variation of Scaling Methods Experiment

Presto

• [x] Experiment Script
• [x] Latency Results on Scale = 100; No partitions dataset.

Polars

• [x] Experiment Script
• [x] Latency Results on Scale = 100; No partitions dataset.

Postgres

• [x] Experiment Script
• [x] Latency Results on Scale = 100; No partitions dataset.

ProgressiveDB

• [x] Experiment Script
• [x] Latency
  • [x] Scale = 100; Partition = 512M
  • [x] Skewed Scale = 100; Partition = 512M
• [ ] Error
  • [ ] Scale = 100; Partition = 512M
  • [ ] Skewed Scale = 100; Partition = 512M

WanderJoin

• [x] Experiment Script
• [x] Latency
  • [x] Scale = 100; Partition = 512M
  • [ ] Skewed Scale = 100; Partition = 512M
• [ ] Error
  • [ ] Scale = 100; Partition = 512M
  • [ ] Skewed Scale = 100; Partition = 512M

[pyongjoo]

@mIXs222 Please leave a comment here if you finish adding placeholder figures. Overleaf link: https://www.overleaf.com/project/6213dd85e75ce371a781fed9