[TPC-H] Adjust default cluster sizes

hendrikmakait commented 9 months ago

Adjusts default cluster sizes following changes suggested in #1166.

Changes: Scale 10

Reduced number of VMs by half from 16 to 8 machines. This is probably better as it felt opverprovisioned.
Halfed single VM size from m6i.8xlarge (32 CPUs, 128 GiB RAM) to m6i.4xlarge (16 CPUs, 64 GiB RAM) to match.

Scale 100 No changes

Scale 1000

Doubled VM size form m6i.large (2 CPUs, 8 GiB RAM) to m6i.xlarge (4 CPUs, 16 GiB RAM). During our latest runs, we've noticed that the configuration for scale 1000 is not large enough and needs to be doubled.
Doubled single VM size from m6i.16xlarge (64 CPUs, 256 GiB RAM) to m6i.32xlarge (128 CPUs, 256 GiB RAM) to match.

Scale 10000

Reduced number of VMs by half from 64 to 32 to match single VM size. Note: We have not run this yet but this is the only way to keep CPU count constant as there's no larger m6i VM available for the single VM types.

phofl commented 9 months ago

I think the argument for scale 10 000 was that this is one of the features of distributed frameworks that you can scale out

hendrikmakait commented 9 months ago

I think the argument for scale 10 000 was that this is one of the features of distributed frameworks that you can scale out

That makes sense, but then we should, at the very least, highlight that it's not a fair comparison.

coiled / benchmarks