search

Azure / doAzureParallel

A R package that allows users to submit parallel workloads in Azure
MIT License
107 stars 51 forks source link

Feature: Batch Insights support #336

Closed brnleehng closed 5 years ago

brnleehng commented 5 years ago

335

sorenvind commented 5 years ago

@brnleehng The merge of this PR is the root cause of the bug I attempted to fix in https://github.com/Azure/doAzureParallel/pull/340. However, the bug fix did not succeed.

By merging the present PR to master, the file at https://raw.githubusercontent.com/Azure/doAzureParallel/master/inst/startup/cluster_setup.sh was changed. The file is referenced in old versions of doAzureParallel (see e.g. https://github.com/Azure/doAzureParallel/blob/v0.6.3/R/cluster.R#L145). Since the set up of docker was removed by this PR, all pools/jobs orchestrated using previous versions of doAzureParallel will fail until this PR is reverted or docker is installed again by the cluster_setup.sh file. It is unclear to me if the version on master could potentially work.

This change has broken the daily runs in our production system relying on Batch for two days now. What can I do to help fix this?