Azure-Samples / Azure-MachineLearning-DataScience

Creative Commons Attribution 4.0 International
409 stars 368 forks source link

Problem in installing sparklyr on R server in HDinsight - Azure #27

Closed etignone closed 6 years ago

etignone commented 8 years ago

Goodmorning,

I am currently using R server on HDinsight in Azure.

I ask you for some help since I can not install sparklyr. When executing devtools::install_github("rstudio/sparklyr") I get the following error message:

ERROR: dependencies ‘tibble’, ‘rprojroot’ are not available for package ‘sparklyr’

Unfortunately I can not install neither ‘tibble’ nor ‘rprojroot’. Do you have any suggestion?

Thank you very much,

Edoardo Tignone

N1h1l1sT commented 6 years ago

After many, many hours of iterating over the correct versions to use, I wrote this code to tackle the problem.

# Current CRAN version does not support Spark2.1 (as of 2017-12-25)
# Workaround:
### Initial Installation ###
# =======================================================================================================
install.packages("tidyverse")
install.packages("devtools")

#For install_github('...') SSL cert problem
httr::set_config(httr::config(ssl_verifypeer = 0L))

#Sparkling Water version 0.X.Y must be the same as Spark version X.Y
#Sparkling Water version: 0.2.1
#Spark version: 2.1
#h2o version 3.16.0.2, H2O Release Name: rel-wheeler, H2O Release Patch Number: 2
devtools::install_github("jeroen/jsonlite", ref = "v1.4")
devtools::install_github("rstudio/httpuv", ref = "v1.3.3")
devtools::install_github("rstudio/shiny", ref = "v1.0.1")
devtools::install_github("tidyverse/rlang", ref = "v0.1.4")
devtools::install_github("tidyverse/glue", ref = "v1.2.0")
devtools::install_github("tidyverse/tibble", ref = "v1.3.3")
devtools::install_github("krlmlr/bindrcpp", ref = "v0.2")
devtools::install_github("tidyverse/dplyr", ref = "v0.7.4") #0.7.2 required
devtools::install_github("tidyverse/dbplyr", ref = "v1.1.0")
devtools::install_github("r-dbi/DBI", ref = "v0.7")
devtools::install_github("rstudio/sparklyr", ref = "v0.6.4")
deguhath commented 6 years ago

Thank you. We also did install the other dependencies prior to sparklyr, like you did.