Open AnasKhann22 opened 1 year ago
Hi @AnasKhann22, thank you for using RAPIDS and reporting this issue! In our lock file, we request that renv install packages from CRAN, but it looks like renv is attempting to install packages from the Microsoft R Application Network (MRAN) here. MRAN was retired on July 1, 2023 and is no longer accessible.
In your copy of rapids, could you please try:
Adding the following line to .Rprofile
:
options(renv.config.mran.enabled = FALSE)
Changing line 19 of rules/renv.smk
to the following:
"R -e 'renv::restore(repos = c(CRAN = \"https://cloud.r-project.org\"))'"
And let us know if that solves the issue?
Could you please also let us know what versions of macOS and R you are using? Unfortunately I was not able to reproduce this particular error, but I am using an Intel MacBook (running macOS Monterey 12.4 and R 4.2.3). Also please note that on M1 chip Macs, R should be installed via brew under Rosetta (x86 arch) due to incompatibility issues with some of the libraries RAPIDS uses (see the "M1 Macs" dropdown under the MacOS tab of our installation instructions and this section of our documentation). Thank you!
Hi @jenniferfedor , Thanks for your reply. After following the above mentioned steps, I'm getting another error now on the same step "snakemake -j1 renv_restore".
R was unable to find one or more FORTRAN libraries during compilation.
This often implies that the FORTRAN compiler has not been properly configured.
Please see https://stackoverflow.com/q/35999874 for more information.
Reason(s):
- 'ld: library not found for -lgfortran'
Error: install of package 'KernSmooth' failed
Traceback (most recent calls last):
14: renv::restore(repos = c(CRAN = "https://cloud.r-project.org"))
13: renv_restore_run_actions(project, diff, current, lockfile, rebuild)
12: renv_install(records, library)
11: renv_install_staged(records, library)
10: renv_install_default(records, library)
9: handler(package, renv_install_impl(record))
8: renv_install_impl(record)
7: withCallingHandlers(renv_install_package_local(record), error = function(e) {
vwritef("\tFAILED")
writef(e$output)
})
6: renv_install_package_local(record)
5: renv_install_package_local_impl(package, path, library)
4: r_cmd_install(package, path, library)
3: r_exec(package, args, "install")
2: r_exec_error(package, output, label)
1: stop(error)
Execution halted
[Tue Aug 29 09:54:38 2023]
Error in rule renv_restore:
jobid: 0
shell:
R -e 'renv::restore(repos = c(CRAN = "https://cloud.r-project.org"))'
(one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)
Shutting down, this might take some time.
Exiting because a job execution failed. Look above for error message
My R version is 4.0..0 and Mac OS is Ventura 13.0.
Hi @AnasKhann22, I'm glad to hear those steps worked. Thanks for letting us know.
It looks like you are either missing a dependency required to compile that package, or R doesn't know where to find it. I would recommend following the suggestions in the Stack Overflow post linked at the top of the error message (https://stackoverflow.com/q/35999874).
Please let us know if you encounter any other issues. Thank you!
Hi @AnasKhann22, just wanted to follow up about this. Were you able to resolve this issue? Thanks!
Hi @jenniferfedor
I have faced similar issue in Mac M1 device. I have followed rosetta brew installation and the rapids documentation. I have got these error even I have followed your above modifications:
`rapids % snakemake -j1 renv_restore Building DAG of jobs... Using shell: /bin/bash Provided cores: 1 (use --cores to define parallelism) Rules claiming more threads will be scaled down. Job counts: count jobs 1 renv_restore 1
[Thu Sep 21 01:54:51 2023] rule renv_restore: jobid: 0
R version 4.3.1 (2023-06-16) -- "Beagle Scouts" Copyright (C) 2023 The R Foundation for Statistical Computing Platform: x86_64-apple-darwin22.4.0 (64-bit)
R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome to redistribute it under certain conditions. Type 'license()' or 'licence()' for distribution details.
Natural language support but running in an English locale
R is a collaborative project with many contributors. Type 'contributors()' for more information and 'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or 'help.start()' for an HTML browser interface to help. Type 'q()' to quit R.
renv::restore(repos = c(CRAN = "https://cloud.r-project.org")) The following package(s) will be updated:
KernSmooth [2.23-21 -> 2.23-18]
MASS [7.3-60 -> 7.3-53]
Matrix [1.5-4.1 -> 1.2-18]
boot [1.3-28.1 -> 1.3-25]
class [7.3-22 -> 7.3-17]
cluster [2.1.4 -> 2.1.0]
codetools [0.2-19 -> 0.2-18]
foreign [0.8-84 -> 0.8-80]
lattice [0.21-8 -> 0.20-41]
mgcv [1.8-42 -> 1.8-33]
nlme [3.1-162 -> 3.1-151]
nnet [7.3-19 -> 7.3-14]
rpart [4.1.19 -> 4.1-15]
spatial [7.3-16 -> 7.3-12]
survival [3.5-5 -> 3.2-7]
BDgraph [* -> 2.63]
BH [* -> 1.72.0-3]
DBI [* -> 1.1.0]
DEoptimR [* -> 1.0-8]
Formula [* -> 1.2-4]
Hmisc [* -> 4.7-0]
R6 [* -> 2.5.0]
RColorBrewer [* -> 1.1-2]
RMariaDB [* -> 1.0.11]
Rcpp [* -> 1.0.5]
RcppArmadillo [* -> 0.10.1.2.0]
RcppEigen [* -> 0.3.3.9.1]
abind [* -> 1.4-5]
acepack [* -> 1.4.1]
askpass [* -> 1.1]
assertthat [* -> 0.2.1]
backports [* -> 1.2.1]
base64enc [* -> 0.1-3]
bit [* -> 4.0.4]
bit64 [* -> 4.0.5]
blob [* -> 1.2.1]
brio [* -> 1.1.0]
broom [* -> 0.7.3]
callr [* -> 3.5.1]
caret [* -> 6.0-89]
cellranger [* -> 1.1.0]
checkmate [* -> 2.0.0]
cli [* -> 3.4.1]
clipr [* -> 0.7.1]
colorspace [* -> 2.0-0]
commonmark [* -> 1.7]
corpcor [* -> 1.6.9]
corrr [* -> 0.4.3]
crayon [* -> 1.3.4]
curl [* -> 4.3]
d3Network [* -> 0.5.2.1]
data.table [* -> 1.14.0]
dbplyr [* -> 2.0.0]
desc [* -> 1.2.0]
diffobj [* -> 0.3.2]
digest [* -> 0.6.27]
dplyr [* -> 1.0.5]
dtplyr [* -> 1.1.0]
ellipsis [* -> 0.3.2]
entropy [* -> 1.2.1]
evaluate [* -> 0.14]
fansi [* -> 0.4.1]
farver [* -> 2.0.3]
fastmap [* -> 1.0.1]
fdrtool [* -> 1.2.15]
forcats [* -> 0.5.0]
foreach [* -> 1.5.1]
fs [* -> 1.5.0]
generics [* -> 0.1.2]
ggforce [* -> 0.3.2]
ggplot2 [* -> 3.3.2]
ggraph [* -> 2.0.4]
ggrepel [* -> 0.9.0]
glasso [* -> 1.11]
glmnet [* -> 4.0-2]
glue [* -> 1.6.2]
graphlayouts [* -> 0.7.1]
gridExtra [* -> 2.3]
gtable [* -> 0.3.0]
gtools [* -> 3.8.2]
haven [* -> 2.3.1]
highr [* -> 0.8]
hms [* -> 0.5.3]
htmlTable [* -> 2.1.0]
htmltools [* -> 0.5.0]
htmlwidgets [* -> 1.5.3]
httpuv [* -> 1.5.4]
httr [* -> 1.4.2]
huge [* -> 1.3.4.1]
igraph [* -> 1.2.6]
influxdbr [* -> 0.14.2]
isoband [* -> 0.2.3]
iterators [* -> 1.0.13]
jpeg [* -> 0.1-8.1]
jsonlite [* -> 1.7.2]
knitr [* -> 1.30]
labeling [* -> 0.4.2]
later [* -> 1.1.0.1]
latticeExtra [* -> 0.6-29]
lavaan [* -> 0.6-7]
lifecycle [* -> 1.0.3]
lubridate [* -> 1.8.0]
magrittr [* -> 2.0.1]
markdown [* -> 1.1]
matrixcalc [* -> 1.0-3]
mgm [* -> 1.2-10]
mime [* -> 0.9]
mnormt [* -> 2.0.2]
modelr [* -> 0.1.8]
munsell [* -> 0.5.0]
numDeriv [* -> 2016.8-1.1]
openssl [* -> 1.4.3]
packrat [* -> 0.5.0]
pbapply [* -> 1.4-3]
pbivnorm [* -> 0.6.0]
pillar [* -> 1.8.1]
pkgbuild [* -> 1.2.0]
pkgconfig [* -> 2.0.3]
pkgload [* -> 1.1.0]
plogr [* -> 0.2.0]
plyr [* -> 1.8.6]
png [* -> 0.1-7]
polyclip [* -> 1.10-0]
praise [* -> 1.0.0]
prettyunits [* -> 1.1.1]
processx [* -> 3.4.5]
progress [* -> 1.2.2]
promises [* -> 1.1.1]
ps [* -> 1.5.0]
psych [* -> 2.0.12]
purrr [* -> 0.3.4]
qgraph [* -> 1.6.5]
rappdirs [* -> 0.3.3]
readr [* -> 1.4.0]
readxl [* -> 1.3.1]
rematch [* -> 1.0.1]
rematch2 [* -> 2.1.2]
reprex [* -> 0.3.0]
reshape2 [* -> 1.4.4]
reticulate [* -> 1.18]
rjson [* -> 0.2.20]
rmarkdown [* -> 2.6]
robustbase [* -> 0.93-6]
rprojroot [* -> 2.0.2]
rstudioapi [* -> 0.13]
rvest [* -> 0.3.6]
scales [* -> 1.1.1]
selectr [* -> 0.4-2]
shape [* -> 1.4.5]
shiny [* -> 1.5.0]
sourcetools [* -> 0.1.7]
stringi [* -> 1.7.6]
stringr [* -> 1.4.0]
sys [* -> 3.4]
testthat [* -> 3.0.1]
tibble [* -> 3.1.7]
tidygraph [* -> 1.2.0]
tidyr [* -> 1.1.2]
tidyverse [* -> 1.3.0]
tinytex [* -> 0.28]
tmvnsim [* -> 1.0-2]
tweenr [* -> 1.0.1]
utf8 [* -> 1.1.4]
vctrs [* -> 0.5.0]
viridis [* -> 0.5.1]
viridisLite [* -> 0.3.0]
waldo [* -> 0.2.3]
whisker [* -> 0.4]
withr [* -> 2.3.0]
xfun [* -> 0.19]
xml2 [* -> 1.3.2]
xtable [* -> 1.8-4]
xts [* -> 0.12.1]
yaml [* -> 2.2.1]
zoo [* -> 1.8-9]
installing source package ‘MASS’ ... package ‘MASS’ successfully unpacked and MD5 sums checked using staged installation * libs using C compiler: ‘Apple clang version 15.0.0 (clang-1500.0.40.1)’ using SDK: ‘MacOSX14.0.sdk’ clang -I"/usr/local/Cellar/r/4.3.1/lib/R/include" -DNDEBUG -I/usr/local/opt/gettext/include -I/usr/local/opt/readline/include -I/usr/local/opt/xz/include -I/usr/local/include -fPIC -g -O2 -c MASS.c -o MASS.o MASS.c:37:23: error: unknown type name 'Sint'; did you mean 'int'? VR_sammon(double dd, Sint nn, Sint kd, double Y, Sint niter, ^~~~ int MASS.c:37:33: error: unknown type name 'Sint'; did you mean 'int'? VR_sammon(double dd, Sint nn, Sint kd, double Y, Sint niter, ^~~~ int MASS.c:37:54: error: unknown type name 'Sint'; did you mean 'int'? VR_sammon(double dd, Sint nn, Sint kd, double Y, Sint niter, ^~~~ int MASS.c:38:20: error: unknown type name 'Sint'; did you mean 'int'? double stress, Sint trace, double aa, double tol) ^~~~ int MASS.c:168:8: error: unknown type name 'Sint'; did you mean 'int'? static Sint ord; / ranks of dissimilarities / ^~~~ int MASS.c:169:8: error: unknown type name 'Sint'; did you mean 'int'? static Sint ord2; / inverse ordering (which one is rank i?) / ^~~~ int MASS.c:170:8: error: unknown type name 'Sint'; did you mean 'int'? static Sint n; / number of dissimilarities / ^~~~ int MASS.c:171:8: error: unknown type name 'Sint'; did you mean 'int'? static Sint nr; / number of data points / ^~~~ int MASS.c:172:8: error: unknown type name 'Sint'; did you mean 'int'? static Sint nc; / # cols of fitted configuration / ^~~~ int MASS.c:181:31: error: unknown type name 'Sint'; did you mean 'int'? VR_mds_fn(double , double , Sint , double , Sint , ^~~~ int MASS.c:181:49: error: unknown type name 'Sint'; did you mean 'int'? VR_mds_fn(double , double , Sint , double , Sint , ^~~~ int MASS.c:182:14: error: unknown type name 'Sint'; did you mean 'int'? double , Sint , Sint , double , Sint , double ); ^~~~ int MASS.c:182:22: error: unknown type name 'Sint'; did you mean 'int'? double , Sint , Sint , double , Sint , double ); ^~~~ int MASS.c:182:40: error: unknown type name 'Sint'; did you mean 'int'? double , Sint , Sint , double , Sint , double ); ^~~~ int MASS.c:188:18: error: unknown type name 'Sint'; did you mean 'int'? VR_mds_init_data(Sint pn, Sint pc, Sint pr, Sint orde, ^~~~ int MASS.c:188:28: error: unknown type name 'Sint'; did you mean 'int'? VR_mds_init_data(Sint pn, Sint pc, Sint pr, Sint orde, ^~~~ int MASS.c:188:38: error: unknown type name 'Sint'; did you mean 'int'? VR_mds_init_data(Sint pn, Sint pc, Sint pr, Sint orde, ^~~~ int MASS.c:188:48: error: unknown type name 'Sint'; did you mean 'int'? VR_mds_init_data(Sint pn, Sint pc, Sint pr, Sint orde, ^~~~ int MASS.c:189:4: error: unknown type name 'Sint'; did you mean 'int'? Sint ordee, double xx, double *p) ^~~~ int fatal error: too many errors emitted, stopping now [-ferror-limit=] 20 errors generated. make: *** [MASS.o] Error 1 ERROR: compilation failed for package ‘MASS’
removing ‘/Users/userX/Desktop/Research/rapids/renv/staging/1/MASS’ Error: install of package 'MASS' failed Traceback (most recent calls last): 14: renv::restore(repos = c(CRAN = "https://cloud.r-project.org")) 13: renv_restore_run_actions(project, diff, current, lockfile, rebuild) 12: renv_install(records, library) 11: renv_install_staged(records, library) 10: renv_install_default(records, library) 9: handler(package, renv_install_impl(record)) 8: renv_install_impl(record) 7: withCallingHandlers(renv_install_package_local(record), error = function(e) { vwritef("\tFAILED") writef(e$output) }) 6: renv_install_package_local(record) 5: renv_install_package_local_impl(package, path, library) 4: r_cmd_install(package, path, library) 3: r_exec(package, args, "install") 2: r_exec_error(package, output, label) 1: stop(error) Execution halted [Thu Sep 21 01:55:18 2023] Error in rule renv_restore: jobid: 0 shell: R -e 'renv::restore(repos = c(CRAN = "https://cloud.r-project.org"))' (one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)
Shutting down, this might take some time. Exiting because a job execution failed. Look above for error message 2023-09-21T015451.394109.snakemake.log
`
Hi @Sabit-Ahmed, thanks for reporting! I see that you have R 4.3.1 installed. Unfortunately the RAPIDS R environment is not currently compatible with versions of R newer than 4.2. This particular error with the MASS package is caused by unknown type name Sint
which was dropped in R 4.3 per the change log (page 9). Could you please try downgrading your R installation to version 4.2.3 and let us know if you continue to experience errors? Thank you!
Hi @Sabit-Ahmed, it looks like your follow-up question about downgrading was deleted, but in case it helps you or others, this post walks through the steps required to install older versions of Homebrew packages. They use terraform as an example but the steps should be applicable to any package.
Here is the link to the bottle for R 4.2.3: https://github.com/Homebrew/homebrew-core/commit/4afd43a67ddbf312ca21c6eb91e964fb8fbb1833
If you give this a try, please let us know how it goes and if it resolves the above issue. If so, we'll update our MacOS installation instructions. Thanks!
Hi @jenniferfedor, thanks for your direction. I followed your guideline, but now getting new set of error.
`Building DAG of jobs... Using shell: /bin/bash Provided cores: 1 (use --cores to define parallelism) Rules claiming more threads will be scaled down. Job counts: count jobs 1 renv_restore 1
[Thu Sep 21 22:01:01 2023] rule renv_restore: jobid: 0
[Thu Sep 21 22:01:22 2023] Error in rule renv_restore: jobid: 0 shell: R -e 'renv::restore(repos = c(CRAN = "https://cloud.r-project.org"))' (one of the commands exited with non-zero exit code; note that snakemake uses bash strict mode!)
Shutting down, this might take some time. Exiting because a job execution failed. Look above for error message Complete log: /Users/userX/Desktop/Research/rapids/.snakemake/log/2023-09-21T220100.644673.snakemake.log `
Hi @Sabit-Ahmed, thank you for trying those steps and reporting back. I am not seeing an error message above that explains why this rule failed.
Can you please check that R 4.2.3 was installed successfully?
(base) ccupcilowlt02:~ jenniferfedor$ which R
/usr/local/bin/R
(base) ccupcilowlt02:~ jenniferfedor$ R
R version 4.2.3 (2023-03-15) -- "Shortstop Beagle"
Copyright (C) 2023 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin21.6.0 (64-bit)
In the meantime, please feel free to use RAPIDS via our Docker container. Thanks!
The version installed in my pc is 4.2.3. However, I have managed to work with the docker version of rapids. Thanks for the information.
(base) @SIE-GL41J2PQJK ~ % which R
/usr/local/bin/R
(base) @SIE-GL41J2PQJK ~ % R
R version 4.2.3 (2023-03-15) -- "Shortstop Beagle"
Copyright (C) 2023 The R Foundation for Statistical Computing
Platform: x86_64-apple-darwin22.3.0 (64-bit)
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
Natural language support but running in an English locale
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
While installing the RAPIDs on my MacBook M1 2020, at Step 7 which is "Install R packages and virtual environment:" and while executing "snakemake -j1 renv_restore", I am getting below error on the terminal:
Shutting down, this might take some time. Exiting because a job execution failed. Look above for error message Complete log: /Users/anaskhan/Documents/PhD/My Research/Data/rapids/.snakemake/log/2023-08-22T105348.044124.snakemake.log