parsa-epfl / cloudsuite

A Benchmark Suite for Cloud Services.
http://cloudsuite.ch
Other
210 stars 121 forks source link

Analytics workloads upgrade #416

Closed UlisesLuzius closed 1 year ago

UlisesLuzius commented 1 year ago

This commit includes:

  1. in-memory-analytics and graph-analytics: Spark and scala version update for
  2. data-analytics: arguments to control number of cores, memory allocated
  3. data-analytics: separation of dataset to other container
  4. data-analytics: separation of master and slave, allow for IP passing instead of hostname
UlisesLuzius commented 1 year ago

We are missing modifications GitHub CI modifications to build:

  1. Wikimedia dataset
  2. New versions of Spark and Hadoop
  3. Correct the path of bench-analytics/4.0 to bench-analytics