Sparklens assumes all executors are available for the whole job duration! This means that dynamic allocation is not included.
executorCores: 1, maxExecutors: 3, totalCores: 3
jobTime: 37916, appTotalTime: 40310, driverTimeJobBased: 2394
inJobComputeMillisUsed: 72964, inJobComputeMillisAvailable: 113748, appComputeMillisAvailable: 120930
Note: Sparklens assumes all executors are available for the whole job duration! This means that dynamic allocation is not included.
Sparklens assumes all executors are available for the whole job duration! This means that dynamic allocation is not included. executorCores: 1, maxExecutors: 3, totalCores: 3 jobTime: 37916, appTotalTime: 40310, driverTimeJobBased: 2394 inJobComputeMillisUsed: 72964, inJobComputeMillisAvailable: 113748, appComputeMillisAvailable: 120930 Note: Sparklens assumes all executors are available for the whole job duration! This means that dynamic allocation is not included.