girke-lab / signatureSearch

R/Bioconductor package including the Gene Expression Signature Search (GESS), Function Enrichment Analysis (FEA) methods and supporting drug-target network construction for visualization
17 stars 4 forks source link

Failed to connect to local data base using gess_lincs #8

Closed lizzyjoan closed 2 years ago

lizzyjoan commented 2 years ago

Hello,

I am getting an error trying to use the gess functions. lincs_gess <- gess_lincs(qsig_lincs, sortby="NCS", tau=FALSE, workers=1) Error: failed to connect to local data base database: ‘/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3’ reason: DB file '/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3' not found

I believe this was the old default cache location for ExperimentHub and the default location changed with an update, and when I've followed the signatureSearch vignette to connect to the lincs reference database, it looks like it's stored in the new, local path

lincs EH3226 "/Users/eramsey/Library/Caches/org.R-project.R/R/ExperimentHub/608e44d025bf_3242"

My reference database path:

qsig_lincs@refdb [1] "/Users/eramsey/Library/Caches/org.R-project.R/R/ExperimentHub/608e44d025bf_3242"

So I'm not sure why it's trying to connect to the data base at ‘/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3’

I also tried to build my own reference database from LINCS (following the signatureSearchData vignette) to try to avoid using ExperimentHub and it actually still ran into this error.

sessionInfo() R version 4.1.1 (2021-08-10) Platform: x86_64-apple-darwin17.0 (64-bit) Running under: macOS Big Sur 11.6

Matrix products: default LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

locale: [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages: [1] stats4 stats graphics grDevices utils datasets methods base

other attached packages: [1] devtools_2.4.2 usethis_2.1.3
[3] signatureSearchData_1.8.0 gprofiler2_0.2.1
[5] GeoDE_1.0 MASS_7.3-54
[7] Matrix_1.3-4 stringr_1.4.0
[9] dplyr_1.0.7 cmapR_1.6.0
[11] RSQLite_2.2.8.9000 signatureSearch_1.8.0
[13] SummarizedExperiment_1.24.0 Biobase_2.54.0
[15] GenomicRanges_1.46.0 GenomeInfoDb_1.30.0
[17] IRanges_2.28.0 S4Vectors_0.32.2
[19] MatrixGenerics_1.6.0 matrixStats_0.61.0
[21] Rcpp_1.0.7 ExperimentHub_2.2.0
[23] AnnotationHub_3.2.0 BiocGenerics_0.40.0
[25] BiocFileCache_2.2.0 dbplyr_2.1.1

image

Thank you for your time

yduan004 commented 2 years ago

Hi Ramsey,

Thanks for your very detailed error desperation. It is very helpful! Many others are also encountering this type of error from the ExperimentHub package. I didn’t made any changes to the signatureSearch package. I guess the error was raised from the updates of ExperimentHub package. It is caused by running the eh <- ExperimentHub() code from the signatureSearch package, while users could run this code at the global environment. It is strange that the default cache location by running this code from the signatureSearch package is different from running it at RStudio/global environment. I am also debugging it, have no clue yet. Maybe you could try using the older version of the ExperimentHub package or creating the symbolic link of the old cached location to the new cached location so that the experimenthub sqlite3 file can be found?

Best, Yuzhu

On Nov 12, 2021, at 7:07 PM, Lizzy Ramsey @.***> wrote:

Hello,

I am getting an error trying to use the gess functions. lincs_gess <- gess_lincs(qsig_lincs, sortby="NCS", tau=FALSE, workers=1) Error: failed to connect to local data base database: ‘/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3’ reason: DB file '/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3' not found

I believe this was the old default cache location for ExperimentHub and the default location changed with an update, and when I've followed the signatureSearch vignette to connect to the lincs reference database, it looks like it's stored in the new, local path

lincs EH3226 "/Users/eramsey/Library/Caches/org.R-project.R/R/ExperimentHub/608e44d025bf_3242"

My reference database path:

@.*** [1] "/Users/eramsey/Library/Caches/org.R-project.R/R/ExperimentHub/608e44d025bf_3242"

So I'm not sure why it's trying to connect to the data base at ‘/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3’

I also tried to build my own reference database from LINCS (following the signatureSearchData vignette) to try to avoid using ExperimentHub and it actually still ran into this error.

sessionInfo() R version 4.1.1 (2021-08-10) Platform: x86_64-apple-darwin17.0 (64-bit) Running under: macOS Big Sur 11.6

Matrix products: default LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

locale: [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages: [1] stats4 stats graphics grDevices utils datasets methods base

other attached packages: [1] devtools_2.4.2 usethis_2.1.3 [3] signatureSearchData_1.8.0 gprofiler2_0.2.1 [5] GeoDE_1.0 MASS_7.3-54 [7] Matrix_1.3-4 stringr_1.4.0 [9] dplyr_1.0.7 cmapR_1.6.0 [11] RSQLite_2.2.8.9000 signatureSearch_1.8.0 [13] SummarizedExperiment_1.24.0 Biobase_2.54.0 [15] GenomicRanges_1.46.0 GenomeInfoDb_1.30.0 [17] IRanges_2.28.0 S4Vectors_0.32.2 [19] MatrixGenerics_1.6.0 matrixStats_0.61.0 [21] Rcpp_1.0.7 ExperimentHub_2.2.0 [23] AnnotationHub_3.2.0 BiocGenerics_0.40.0 [25] BiocFileCache_2.2.0 dbplyr_2.1.1

https://user-images.githubusercontent.com/69320986/141603324-9e84b3b0-d971-4383-b1da-6bc7e69240e4.png Thank you for your time

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/yduan004/signatureSearch/issues/8, or unsubscribe https://github.com/notifications/unsubscribe-auth/AFNOIO6VQFJEPVYA57XJKITULXI5RANCNFSM5H6DUNUQ. Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

-- Yuzhu Duan, Ph.D. Candidate Genetics, Genomics and Bioinformatics Program 1207E Genomics Building University of California, Riverside Riverside, CA 92521

Tel: (951)224-7029 Email: @.***

lizzyjoan commented 2 years ago

Thank you so much for the information and suggestions. I will give those a try and keep working on this and I will let you know if I can get it fixed on my side. Please let me know if you figure out a fix and need someone to beta test it; I would be more than happy to test it out. Thank you again, Lizzy

yduan004 commented 2 years ago

Awesome, thanks for trying out and keeping me informed! I will let you know if I fix this bug. It is very helpful, thank you :)

komalsrathi commented 2 years ago

Following this as I am getting the same error and I opened an issue here: https://github.com/Bioconductor/ExperimentHub/issues/23

komalsrathi commented 2 years ago

I updated to the latest R and updated all packages, but most importantly installed the dev version of signatureSearch (signatureSearch_1.7.3), and it seems to be working:

R version 4.1.2 (2021-11-01)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Big Sur 11.6

Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats4    parallel  stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] signatureSearchData_1.6.0   signatureSearch_1.7.3       SummarizedExperiment_1.22.0 Biobase_2.52.0             
 [5] GenomicRanges_1.44.0        GenomeInfoDb_1.28.4         IRanges_2.26.0              S4Vectors_0.30.2           
 [9] MatrixGenerics_1.4.3        matrixStats_0.61.0          Rcpp_1.0.7                  ExperimentHub_2.0.0        
[13] AnnotationHub_3.0.2         BiocFileCache_2.0.0         dbplyr_2.1.1                BiocGenerics_0.38.0        

loaded via a namespace (and not attached):
  [1] shadowtext_0.0.9              fastmatch_1.1-3               plyr_1.8.6                   
  [4] igraph_1.2.8                  lazyeval_0.2.2                GSEABase_1.54.0              
  [7] splines_4.1.2                 BiocParallel_1.26.2           usethis_2.1.3                
 [10] ggplot2_3.3.5                 digest_0.6.28                 yulab.utils_0.0.4            
 [13] htmltools_0.5.2               GOSemSim_2.18.1               viridis_0.6.2                
 [16] GO.db_3.13.0                  fansi_0.5.0                   magrittr_2.0.1               
 [19] memoise_2.0.0                 limma_3.48.3                  tzdb_0.2.0                   
 [22] remotes_2.4.1                 readr_2.1.0                   Biostrings_2.60.2            
 [25] annotate_1.70.0               graphlayouts_0.7.1            R.utils_2.11.0               
 [28] enrichplot_1.12.3             prettyunits_1.1.1             colorspace_2.0-2             
 [31] blob_1.2.2                    rappdirs_0.3.3                ggrepel_0.9.1                
 [34] dplyr_1.0.7                   callr_3.7.0                   crayon_1.4.2                 
 [37] RCurl_1.98-1.5                jsonlite_1.7.2                scatterpie_0.1.7             
 [40] graph_1.70.0                  ape_5.5                       glue_1.5.0                   
 [43] polyclip_1.10-0               gtable_0.3.0                  zlibbioc_1.38.0              
 [46] XVector_0.32.0                DelayedArray_0.18.0           pkgbuild_1.2.0               
 [49] Rhdf5lib_1.14.2               HDF5Array_1.20.0              scales_1.1.1                 
 [52] DOSE_3.18.3                   DBI_1.1.1                     viridisLite_0.4.0            
 [55] xtable_1.8-4                  tidytree_0.3.6                gridGraphics_0.5-1           
 [58] reactome.db_1.76.0            bit_4.0.4                     preprocessCore_1.54.0        
 [61] htmlwidgets_1.5.4             httr_1.4.2                    fgsea_1.18.0                 
 [64] RColorBrewer_1.1-2            ellipsis_0.3.2                R.methodsS3_1.8.1            
 [67] pkgconfig_2.0.3               XML_3.99-0.8                  farver_2.1.0                 
 [70] utf8_1.2.2                    ggplotify_0.1.0               tidyselect_1.1.1             
 [73] rlang_0.4.12                  reshape2_1.4.4                later_1.3.0                  
 [76] AnnotationDbi_1.54.1          munsell_0.5.0                 BiocVersion_3.13.1           
 [79] tools_4.1.2                   visNetwork_2.1.0              cachem_1.0.6                 
 [82] downloader_0.4                cli_3.1.0                     generics_0.1.1               
 [85] RSQLite_2.2.8                 devtools_2.4.2                stringr_1.4.0                
 [88] fastmap_1.1.0                 yaml_2.2.1                    ggtree_3.0.4                 
 [91] processx_3.5.2                bit64_4.0.5                   fs_1.5.0                     
 [94] tidygraph_1.2.0               purrr_0.3.4                   KEGGREST_1.32.0              
 [97] ggraph_2.0.5                  nlme_3.1-153                  mime_0.12                    
[100] R.oo_1.24.0                   aplot_0.1.1                   DO.db_2.9                    
[103] compiler_4.1.2                rstudioapi_0.13               filelock_1.0.2               
[106] curl_4.3.2                    png_0.1-7                     interactiveDisplayBase_1.30.0
[109] affyio_1.62.0                 testthat_3.1.0                treeio_1.16.2                
[112] tibble_3.1.6                  tweenr_1.0.2                  stringi_1.7.5                
[115] ps_1.6.0                      desc_1.4.0                    lattice_0.20-45              
[118] Matrix_1.3-4                  vctrs_0.3.8                   pillar_1.6.4                 
[121] lifecycle_1.0.1               rhdf5filters_1.4.0            BiocManager_1.30.16          
[124] data.table_1.14.2             cowplot_1.1.1                 bitops_1.0-7                 
[127] patchwork_1.1.1               httpuv_1.6.3                  qvalue_2.24.0                
[130] affy_1.70.0                   R6_2.5.1                      promises_1.2.0.1             
[133] gridExtra_2.3                 sessioninfo_1.2.1             MASS_7.3-54                  
[136] assertthat_0.2.1              pkgload_1.2.3                 rhdf5_2.36.0                 
[139] rprojroot_2.0.2               withr_2.4.2                   GenomeInfoDbData_1.2.6       
[142] hms_1.1.1                     clusterProfiler_4.0.5         ggfun_0.0.4                  
[145] grid_4.1.2                    tidyr_1.1.4                   ggforce_0.3.3                
[148] shiny_1.7.1     
yduan004 commented 2 years ago

Great! I guess the reason is that the ExperimentHub and AnnotationHub packages are down-graded from 2.2.0, 3.2.0 to 2.0.0, 3.0.2. There are no major updates for signatureSearch package between 1.7.3 and 1.8.0. Thanks for opening the issue under ExperimentHub package, it is helpful for debugging.

komalsrathi commented 2 years ago

@yduan004 I think you are referring to the versions used by the OP in this issue.

If you look through the ExperimentHub issue that I opened, you will notice that I was using the same versions of ExperimentHub and AnnotationHub before as well - the only change I can see is the version of signatureSearch.

yduan004 commented 2 years ago

Oh, yes, you are correct.

lizzyjoan commented 2 years ago

Thank you so much for sharing your resolution! I installed signatureSearch 1.7.3 and the gess function is working again for me as well.

image

I updated to the latest R and updated all packages, but most importantly installed the dev version of signatureSearch (signatureSearch_1.7.3), and it seems to be working:

R version 4.1.2 (2021-11-01)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Big Sur 11.6

Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats4    parallel  stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] signatureSearchData_1.6.0   signatureSearch_1.7.3       SummarizedExperiment_1.22.0 Biobase_2.52.0             
 [5] GenomicRanges_1.44.0        GenomeInfoDb_1.28.4         IRanges_2.26.0              S4Vectors_0.30.2           
 [9] MatrixGenerics_1.4.3        matrixStats_0.61.0          Rcpp_1.0.7                  ExperimentHub_2.0.0        
[13] AnnotationHub_3.0.2         BiocFileCache_2.0.0         dbplyr_2.1.1                BiocGenerics_0.38.0        

loaded via a namespace (and not attached):
  [1] shadowtext_0.0.9              fastmatch_1.1-3               plyr_1.8.6                   
  [4] igraph_1.2.8                  lazyeval_0.2.2                GSEABase_1.54.0              
  [7] splines_4.1.2                 BiocParallel_1.26.2           usethis_2.1.3                
 [10] ggplot2_3.3.5                 digest_0.6.28                 yulab.utils_0.0.4            
 [13] htmltools_0.5.2               GOSemSim_2.18.1               viridis_0.6.2                
 [16] GO.db_3.13.0                  fansi_0.5.0                   magrittr_2.0.1               
 [19] memoise_2.0.0                 limma_3.48.3                  tzdb_0.2.0                   
 [22] remotes_2.4.1                 readr_2.1.0                   Biostrings_2.60.2            
 [25] annotate_1.70.0               graphlayouts_0.7.1            R.utils_2.11.0               
 [28] enrichplot_1.12.3             prettyunits_1.1.1             colorspace_2.0-2             
 [31] blob_1.2.2                    rappdirs_0.3.3                ggrepel_0.9.1                
 [34] dplyr_1.0.7                   callr_3.7.0                   crayon_1.4.2                 
 [37] RCurl_1.98-1.5                jsonlite_1.7.2                scatterpie_0.1.7             
 [40] graph_1.70.0                  ape_5.5                       glue_1.5.0                   
 [43] polyclip_1.10-0               gtable_0.3.0                  zlibbioc_1.38.0              
 [46] XVector_0.32.0                DelayedArray_0.18.0           pkgbuild_1.2.0               
 [49] Rhdf5lib_1.14.2               HDF5Array_1.20.0              scales_1.1.1                 
 [52] DOSE_3.18.3                   DBI_1.1.1                     viridisLite_0.4.0            
 [55] xtable_1.8-4                  tidytree_0.3.6                gridGraphics_0.5-1           
 [58] reactome.db_1.76.0            bit_4.0.4                     preprocessCore_1.54.0        
 [61] htmlwidgets_1.5.4             httr_1.4.2                    fgsea_1.18.0                 
 [64] RColorBrewer_1.1-2            ellipsis_0.3.2                R.methodsS3_1.8.1            
 [67] pkgconfig_2.0.3               XML_3.99-0.8                  farver_2.1.0                 
 [70] utf8_1.2.2                    ggplotify_0.1.0               tidyselect_1.1.1             
 [73] rlang_0.4.12                  reshape2_1.4.4                later_1.3.0                  
 [76] AnnotationDbi_1.54.1          munsell_0.5.0                 BiocVersion_3.13.1           
 [79] tools_4.1.2                   visNetwork_2.1.0              cachem_1.0.6                 
 [82] downloader_0.4                cli_3.1.0                     generics_0.1.1               
 [85] RSQLite_2.2.8                 devtools_2.4.2                stringr_1.4.0                
 [88] fastmap_1.1.0                 yaml_2.2.1                    ggtree_3.0.4                 
 [91] processx_3.5.2                bit64_4.0.5                   fs_1.5.0                     
 [94] tidygraph_1.2.0               purrr_0.3.4                   KEGGREST_1.32.0              
 [97] ggraph_2.0.5                  nlme_3.1-153                  mime_0.12                    
[100] R.oo_1.24.0                   aplot_0.1.1                   DO.db_2.9                    
[103] compiler_4.1.2                rstudioapi_0.13               filelock_1.0.2               
[106] curl_4.3.2                    png_0.1-7                     interactiveDisplayBase_1.30.0
[109] affyio_1.62.0                 testthat_3.1.0                treeio_1.16.2                
[112] tibble_3.1.6                  tweenr_1.0.2                  stringi_1.7.5                
[115] ps_1.6.0                      desc_1.4.0                    lattice_0.20-45              
[118] Matrix_1.3-4                  vctrs_0.3.8                   pillar_1.6.4                 
[121] lifecycle_1.0.1               rhdf5filters_1.4.0            BiocManager_1.30.16          
[124] data.table_1.14.2             cowplot_1.1.1                 bitops_1.0-7                 
[127] patchwork_1.1.1               httpuv_1.6.3                  qvalue_2.24.0                
[130] affy_1.70.0                   R6_2.5.1                      promises_1.2.0.1             
[133] gridExtra_2.3                 sessioninfo_1.2.1             MASS_7.3-54                  
[136] assertthat_0.2.1              pkgload_1.2.3                 rhdf5_2.36.0                 
[139] rprojroot_2.0.2               withr_2.4.2                   GenomeInfoDbData_1.2.6       
[142] hms_1.1.1                     clusterProfiler_4.0.5         ggfun_0.0.4                  
[145] grid_4.1.2                    tidyr_1.1.4                   ggforce_0.3.3                
[148] shiny_1.7.1     
liamkelley93 commented 2 years ago

I am encountering the same issue. I have been following the code in the vignette and have been getting the error when running gess_cmap.

> cmap <- gess_cmap(qSig=qsig_cmap, chunk_size=5000, workers=1)
Error: failed to connect to local data base
  database: ‘/Users/liam2/Library/Caches/org.R-project.R/R/ExperimentHub/2b045bcad73e_experimenthub.sqlite3’
  reason: DB file '/Users/liam2/Library/Caches/org.R-project.R/R/ExperimentHub/2b045bcad73e_experimenthub.sqlite3' not found

Following the advice from this thread, I updated BioConductor to 3.14 and updated signatureSearch to 1.7.3 (sidenote: why is the version on BioConductor 1.8.0?). However, this did not fix the issue.

SessionInfo:

R version 4.1.2 (2021-11-01)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Big Sur 11.6

Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats4    stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] HDF5Array_1.22.1            DelayedArray_0.20.0         Matrix_1.3-4               
 [4] signatureSearchData_1.8.0   rhdf5_2.38.0                ExperimentHub_2.2.0        
 [7] AnnotationHub_3.2.0         BiocFileCache_2.2.0         dbplyr_2.1.1               
[10] signatureSearch_1.7.3       SummarizedExperiment_1.24.0 Biobase_2.54.0             
[13] GenomicRanges_1.46.1        GenomeInfoDb_1.30.0         IRanges_2.28.0             
[16] S4Vectors_0.32.3            BiocGenerics_0.40.0         MatrixGenerics_1.6.0       
[19] matrixStats_0.61.0          Rcpp_1.0.7                 

loaded via a namespace (and not attached):
  [1] shadowtext_0.0.9              fastmatch_1.1-3              
  [3] plyr_1.8.6                    igraph_1.2.9                 
  [5] lazyeval_0.2.2                GSEABase_1.56.0              
  [7] splines_4.1.2                 BiocParallel_1.28.2          
  [9] ggplot2_3.3.5                 digest_0.6.28                
 [11] yulab.utils_0.0.4             htmltools_0.5.2              
 [13] GOSemSim_2.20.0               viridis_0.6.2                
 [15] GO.db_3.14.0                  fansi_0.5.0                  
 [17] magrittr_2.0.1                memoise_2.0.1                
 [19] limma_3.50.0                  tzdb_0.2.0                   
 [21] Biostrings_2.62.0             readr_2.1.0                  
 [23] annotate_1.72.0               graphlayouts_0.7.2           
 [25] R.utils_2.11.0                enrichplot_1.14.1            
 [27] colorspace_2.0-2              blob_1.2.2                   
 [29] rappdirs_0.3.3                ggrepel_0.9.1                
 [31] dplyr_1.0.7                   crayon_1.4.2                 
 [33] RCurl_1.98-1.5                jsonlite_1.7.2               
 [35] graph_1.72.0                  scatterpie_0.1.7             
 [37] ape_5.5                       glue_1.5.0                   
 [39] polyclip_1.10-0               gtable_0.3.0                 
 [41] zlibbioc_1.40.0               XVector_0.34.0               
 [43] Rhdf5lib_1.16.0               scales_1.1.1                 
 [45] DOSE_3.20.1                   DBI_1.1.1                    
 [47] viridisLite_0.4.0             xtable_1.8-4                 
 [49] gridGraphics_0.5-1            tidytree_0.3.6               
 [51] bit_4.0.4                     reactome.db_1.77.0           
 [53] preprocessCore_1.56.0         htmlwidgets_1.5.4            
 [55] httr_1.4.2                    fgsea_1.20.0                 
 [57] RColorBrewer_1.1-2            ellipsis_0.3.2               
 [59] R.methodsS3_1.8.1             pkgconfig_2.0.3              
 [61] XML_3.99-0.8                  farver_2.1.0                 
 [63] utf8_1.2.2                    ggplotify_0.1.0              
 [65] tidyselect_1.1.1              rlang_0.4.12                 
 [67] reshape2_1.4.4                later_1.3.0                  
 [69] AnnotationDbi_1.56.2          munsell_0.5.0                
 [71] BiocVersion_3.14.0            tools_4.1.2                  
 [73] visNetwork_2.1.0              cachem_1.0.6                 
 [75] downloader_0.4                generics_0.1.1               
 [77] RSQLite_2.2.8                 stringr_1.4.0                
 [79] fastmap_1.1.0                 yaml_2.2.1                   
 [81] ggtree_3.2.1                  bit64_4.0.5                  
 [83] tidygraph_1.2.0               purrr_0.3.4                  
 [85] KEGGREST_1.34.0               ggraph_2.0.5                 
 [87] nlme_3.1-153                  mime_0.12                    
 [89] R.oo_1.24.0                   aplot_0.1.1                  
 [91] DO.db_2.9                     compiler_4.1.2               
 [93] rstudioapi_0.13               filelock_1.0.2               
 [95] curl_4.3.2                    png_0.1-7                    
 [97] interactiveDisplayBase_1.32.0 affyio_1.64.0                
 [99] treeio_1.18.1                 tibble_3.1.6                 
[101] tweenr_1.0.2                  stringi_1.7.6                
[103] lattice_0.20-45               vctrs_0.3.8                  
[105] pillar_1.6.4                  lifecycle_1.0.1              
[107] rhdf5filters_1.6.0            BiocManager_1.30.16          
[109] data.table_1.14.2             bitops_1.0-7                 
[111] httpuv_1.6.3                  patchwork_1.1.1              
[113] qvalue_2.26.0                 affy_1.72.0                  
[115] R6_2.5.1                      promises_1.2.0.1             
[117] gridExtra_2.3                 MASS_7.3-54                  
[119] assertthat_0.2.1              withr_2.4.2                  
[121] GenomeInfoDbData_1.2.7        hms_1.1.1                    
[123] parallel_4.1.2                clusterProfiler_4.2.0        
[125] grid_4.1.2                    ggfun_0.0.4                  
[127] tidyr_1.1.4                   ggforce_0.3.3                
[129] shiny_1.7.1
yduan004 commented 2 years ago

Thanks for your report! Could you also please try using the signatureSearch 1.8.0 version? The 1.7.3 version is exactly the same as the 1.8.0 version, but since you use Bioconductor 3.14, how about using the 1.8.0 version as a trial to see whether it solves the issue? It is strange, since your current work environment is exactly the same as lizzyjoan, and it works for her...

yduan004 commented 2 years ago

Hi @liamkelley93, I find out the reason is that if the signatureSearch package is installed from Bioconductor by running BiocManager::install(), the ExperimentHub cache location is set as /Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/, maybe due to the package is built from Bioconductor platform and we install the package from the tar.gz file. The ExperimentHub cache location will be correct (in my case, it is /Users/yuzhu/Library/Caches/org.R-project.R/R/ExperimentHub/) if the signatureSearch package is built and installed from GitHub by running devtools::install_github("yduan004/signatureSearch", build_vignettes=FALSE). Overall, I guess the issue comes from that the ExperimentHub cache location running from the package is determined by the platform that the package was built, it is a different path from running it on the R studio global environment if it is not built locally. I will continue to look into it to fix this issue to make sure it works when installing the package from Bioconductor. As a temporary solution, please install it from GitHub. If you run into any problems, please let me know. Thanks!

liamkelley93 commented 2 years ago

Hi @yduan004, thank you for the response. I reinstalled signatureSearch from GitHub, installing the new 1.9.1 version, but am getting the same error as before. Let me know if I misread any of your instructions or missed anything, or if you have any other ideas. You briefly mentioned RStudio and I wanted to clarify that I am indeed using RStudio, could that play a factor?

> cmap <- gess_cmap(qSig=qsig_cmap, chunk_size=5000, workers=1)
Error: failed to connect to local data base
  database: ‘/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3’
  reason: DB file '/Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/37de51dbb5aa_experimenthub.sqlite3' not found

SessionInfo:

R version 4.1.2 (2021-11-01)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Big Sur 11.6

Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats4    stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] HDF5Array_1.22.1            DelayedArray_0.20.0         Matrix_1.3-4               
 [4] signatureSearchData_1.8.0   rhdf5_2.38.0                ExperimentHub_2.2.0        
 [7] AnnotationHub_3.2.0         BiocFileCache_2.2.0         dbplyr_2.1.1               
[10] signatureSearch_1.9.1       SummarizedExperiment_1.24.0 Biobase_2.54.0             
[13] GenomicRanges_1.46.1        GenomeInfoDb_1.30.0         IRanges_2.28.0             
[16] S4Vectors_0.32.3            BiocGenerics_0.40.0         MatrixGenerics_1.6.0       
[19] matrixStats_0.61.0          Rcpp_1.0.7                 

loaded via a namespace (and not attached):
  [1] shadowtext_0.0.9              fastmatch_1.1-3              
  [3] plyr_1.8.6                    igraph_1.2.9                 
  [5] lazyeval_0.2.2                GSEABase_1.56.0              
  [7] splines_4.1.2                 BiocParallel_1.28.2          
  [9] usethis_2.1.3                 ggplot2_3.3.5                
 [11] digest_0.6.29                 yulab.utils_0.0.4            
 [13] htmltools_0.5.2               GOSemSim_2.20.0              
 [15] viridis_0.6.2                 GO.db_3.14.0                 
 [17] fansi_0.5.0                   magrittr_2.0.1               
 [19] memoise_2.0.1                 remotes_2.4.2                
 [21] limma_3.50.0                  tzdb_0.2.0                   
 [23] Biostrings_2.62.0             readr_2.1.1                  
 [25] annotate_1.72.0               graphlayouts_0.7.2           
 [27] R.utils_2.11.0                prettyunits_1.1.1            
 [29] enrichplot_1.14.1             colorspace_2.0-2             
 [31] blob_1.2.2                    rappdirs_0.3.3               
 [33] ggrepel_0.9.1                 dplyr_1.0.7                  
 [35] callr_3.7.0                   crayon_1.4.2                 
 [37] RCurl_1.98-1.5                jsonlite_1.7.2               
 [39] graph_1.72.0                  scatterpie_0.1.7             
 [41] ape_5.5                       glue_1.5.1                   
 [43] polyclip_1.10-0               gtable_0.3.0                 
 [45] zlibbioc_1.40.0               XVector_0.34.0               
 [47] pkgbuild_1.2.1                Rhdf5lib_1.16.0              
 [49] scales_1.1.1                  DOSE_3.20.1                  
 [51] DBI_1.1.1                     viridisLite_0.4.0            
 [53] xtable_1.8-4                  gridGraphics_0.5-1           
 [55] tidytree_0.3.6                bit_4.0.4                    
 [57] reactome.db_1.77.0            preprocessCore_1.56.0        
 [59] htmlwidgets_1.5.4             httr_1.4.2                   
 [61] fgsea_1.20.0                  RColorBrewer_1.1-2           
 [63] ellipsis_0.3.2                R.methodsS3_1.8.1            
 [65] pkgconfig_2.0.3               XML_3.99-0.8                 
 [67] farver_2.1.0                  utf8_1.2.2                   
 [69] ggplotify_0.1.0               tidyselect_1.1.1             
 [71] rlang_0.4.12                  reshape2_1.4.4               
 [73] later_1.3.0                   AnnotationDbi_1.56.2         
 [75] munsell_0.5.0                 BiocVersion_3.14.0           
 [77] tools_4.1.2                   visNetwork_2.1.0             
 [79] cachem_1.0.6                  cli_3.1.0                    
 [81] downloader_0.4                generics_0.1.1               
 [83] RSQLite_2.2.8                 devtools_2.4.3               
 [85] stringr_1.4.0                 fastmap_1.1.0                
 [87] yaml_2.2.1                    ggtree_3.2.1                 
 [89] processx_3.5.2                fs_1.5.1                     
 [91] bit64_4.0.5                   tidygraph_1.2.0              
 [93] purrr_0.3.4                   KEGGREST_1.34.0              
 [95] ggraph_2.0.5                  nlme_3.1-153                 
 [97] mime_0.12                     R.oo_1.24.0                  
 [99] aplot_0.1.1                   DO.db_2.9                    
[101] compiler_4.1.2                rstudioapi_0.13              
[103] filelock_1.0.2                curl_4.3.2                   
[105] png_0.1-7                     interactiveDisplayBase_1.32.0
[107] testthat_3.1.0                affyio_1.64.0                
[109] treeio_1.18.1                 tibble_3.1.6                 
[111] tweenr_1.0.2                  stringi_1.7.6                
[113] ps_1.6.0                      desc_1.4.0                   
[115] lattice_0.20-45               vctrs_0.3.8                  
[117] pillar_1.6.4                  lifecycle_1.0.1              
[119] rhdf5filters_1.6.0            BiocManager_1.30.16          
[121] data.table_1.14.2             bitops_1.0-7                 
[123] httpuv_1.6.3                  patchwork_1.1.1              
[125] qvalue_2.26.0                 affy_1.72.0                  
[127] R6_2.5.1                      promises_1.2.0.1             
[129] gridExtra_2.3                 sessioninfo_1.2.1            
[131] pkgload_1.2.4                 MASS_7.3-54                  
[133] assertthat_0.2.1              rprojroot_2.0.2              
[135] withr_2.4.3                   GenomeInfoDbData_1.2.7       
[137] hms_1.1.1                     parallel_4.1.2               
[139] clusterProfiler_4.2.0         grid_4.1.2                   
[141] ggfun_0.0.4                   tidyr_1.1.4                  
[143] ggforce_0.3.3                 shiny_1.7.1  
yduan004 commented 2 years ago

Hi @liamkelley93, It is strange.. Would you mind sending me an email to arrange a Zoom meeting so that we can debug together? My email address is yduan004@ucr.edu. I am available all today.

yduan004 commented 2 years ago

Just a note, please close and re-open the R session after installing the package so that the newly installed version can be effective, otherwise the function calls are still from the old version even though the sessionInfo() shows the new version of the package.

lizzyjoan commented 2 years ago

Hi @liamkelley93, I find out the reason is that if the signatureSearch package is installed from Bioconductor by running BiocManager::install(), the ExperimentHub cache location is set as /Users/biocbuild/Library/Caches/org.R-project.R/R/ExperimentHub/, maybe due to the package is built from Bioconductor platform and we install the package from the tar.gz file. The ExperimentHub cache location will be correct (in my case, it is /Users/yuzhu/Library/Caches/org.R-project.R/R/ExperimentHub/) if the signatureSearch package is built and installed from GitHub by running devtools::install_github("yduan004/signatureSearch", build_vignettes=FALSE). Overall, I guess the issue comes from that the ExperimentHub cache location running from the package is determined by the platform that the package was built, it is a different path from running it on the R studio global environment if it is not built locally. I will continue to look into it to fix this issue to make sure it works when installing the package from Bioconductor. As a temporary solution, please install it from GitHub. If you run into any problems, please let me know. Thanks!

I gave this a try and it also worked for me! The gess functions are working fine with signatureSearch 1.9.2 when installed using devtools::install_github("yduan004/signatureSearch", build_vignettes=FALSE) and then restarting R -- and right before trying this I had tried again to install the newest version using Biocmanager and it was not working again. So it does seem like that installation method, not the older version of signatureSearch itself, that is making the gess functions work properly again.

sessionInfo()
R version 4.1.1 (2021-08-10)
Platform: x86_64-apple-darwin17.0 (64-bit)
Running under: macOS Big Sur 11.6

Matrix products: default
LAPACK: /Library/Frameworks/R.framework/Versions/4.1/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats4    stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] signatureSearch_1.9.2       SummarizedExperiment_1.24.0 Biobase_2.54.0             
 [4] GenomicRanges_1.46.1        GenomeInfoDb_1.30.0         IRanges_2.28.0             
 [7] S4Vectors_0.32.3            MatrixGenerics_1.6.0        matrixStats_0.61.0         
[10] Rcpp_1.0.7                  signatureSearchData_1.8.0   rhdf5_2.38.0               
[13] ExperimentHub_2.2.0         AnnotationHub_3.2.0         BiocFileCache_2.2.0        
[16] BiocGenerics_0.40.0         ggplot2_3.3.5               gprofiler2_0.2.1           
[19] GeoDE_1.0                   MASS_7.3-54                 Matrix_1.3-4               
[22] stringr_1.4.0               cmapR_1.6.0                 dbplyr_2.1.1               

loaded via a namespace (and not attached):
  [1] utf8_1.2.2                    R.utils_2.11.0                tidyselect_1.1.1             
  [4] RSQLite_2.2.9.9000            AnnotationDbi_1.56.2          htmlwidgets_1.5.4            
  [7] grid_4.1.1                    BiocParallel_1.28.2           devtools_2.4.2               
 [10] scatterpie_0.1.7              flowCore_2.6.0                munsell_0.5.0                
 [13] preprocessCore_1.56.0         withr_2.4.3                   colorspace_2.0-2             
 [16] GOSemSim_2.20.0               filelock_1.0.2                knitr_1.36                   
 [19] rstudioapi_0.13               DOSE_3.20.1                   GenomeInfoDbData_1.2.7       
 [22] polyclip_1.10-0               bit64_4.0.5                   farver_2.1.0                 
 [25] rprojroot_2.0.2               downloader_0.4                vctrs_0.3.8                  
 [28] treeio_1.18.1                 generics_0.1.1                xfun_0.28                    
 [31] R6_2.5.1                      graphlayouts_0.7.2            bitops_1.0-7                 
 [34] rhdf5filters_1.6.0            cachem_1.0.6                  fgsea_1.20.0                 
 [37] gridGraphics_0.5-1            DelayedArray_0.20.0           assertthat_0.2.1             
 [40] promises_1.2.0.1              scales_1.1.1                  ggraph_2.0.5                 
 [43] enrichplot_1.14.1             gtable_0.3.0                  affy_1.72.0                  
 [46] processx_3.5.2                RProtoBufLib_2.6.0            tidygraph_1.2.0              
 [49] rlang_0.4.12                  splines_4.1.1                 lazyeval_0.2.2               
 [52] BiocManager_1.30.16           yaml_2.2.1                    reshape2_1.4.4               
 [55] httpuv_1.6.3                  qvalue_2.26.0                 clusterProfiler_4.2.0        
 [58] tools_4.1.1                   usethis_2.1.3                 ggplotify_0.1.0              
 [61] affyio_1.64.0                 ellipsis_0.3.2                RColorBrewer_1.1-2           
 [64] sessioninfo_1.2.1             plyr_1.8.6                    visNetwork_2.1.0             
 [67] zlibbioc_1.40.0               purrr_0.3.4                   RCurl_1.98-1.5               
 [70] ps_1.6.0                      prettyunits_1.1.1             viridis_0.6.2                
 [73] ggrepel_0.9.1                 fs_1.5.1                      magrittr_2.0.1               
 [76] data.table_1.14.2             DO.db_2.9                     reactome.db_1.77.0           
 [79] pkgload_1.2.3                 evaluate_0.14                 hms_1.1.1                    
 [82] patchwork_1.1.1               mime_0.12                     xtable_1.8-4                 
 [85] XML_3.99-0.8                  gridExtra_2.3                 testthat_3.1.0               
 [88] compiler_4.1.1                tibble_3.1.6                  shadowtext_0.0.9             
 [91] crayon_1.4.2                  R.oo_1.24.0                   htmltools_0.5.2              
 [94] tzdb_0.2.0                    ggfun_0.0.4                   later_1.3.0                  
 [97] tidyr_1.1.4                   aplot_0.1.1                   RcppParallel_5.1.4           
[100] DBI_1.1.1                     tweenr_1.0.2                  rappdirs_0.3.3               
[103] readr_2.1.1                   cli_3.1.0                     R.methodsS3_1.8.1            
[106] parallel_4.1.1                igraph_1.2.9                  pkgconfig_2.0.3              
[109] plotly_4.10.0                 ggtree_3.2.1                  annotate_1.72.0              
[112] XVector_0.34.0                yulab.utils_0.0.4             callr_3.7.0                  
[115] digest_0.6.29                 graph_1.72.0                  Biostrings_2.62.0            
[118] rmarkdown_2.11                fastmatch_1.1-3               tidytree_0.3.6               
[121] GSEABase_1.56.0               curl_4.3.2                    shiny_1.7.1                  
[124] lifecycle_1.0.1               nlme_3.1-153                  jsonlite_1.7.2               
[127] Rhdf5lib_1.16.0               desc_1.4.0                    viridisLite_0.4.0            
[130] limma_3.50.0                  fansi_0.5.0                   pillar_1.6.4                 
[133] lattice_0.20-45               KEGGREST_1.34.0               fastmap_1.1.0                
[136] httr_1.4.2                    pkgbuild_1.2.0                GO.db_3.14.0                 
[139] interactiveDisplayBase_1.32.0 glue_1.5.1                    remotes_2.4.1                
[142] png_0.1-7                     BiocVersion_3.14.0            bit_4.0.4                    
[145] ggforce_0.3.3                 stringi_1.7.6                 HDF5Array_1.22.1             
[148] blob_1.2.2                    memoise_2.0.1                 dplyr_1.0.7                  
[151] cytolib_2.6.0                 ape_5.5  
yduan004 commented 2 years ago

Good news! I made some changes and pushed to a new version 1.8.2 and now it is available on Bioconductor at https://bioconductor.org/packages/release/bioc/html/signatureSearch.html. The 1.8.2 version works when install it directly from Bioconductor by running BiocManager::install() on Mac OS. Please give it a try to see whether it works for you.

jha14 commented 2 years ago

First of all thanks to the author for developing such a powerful and integrative tool for drug repurposing. I recommend it also to my lab colleagues and now it is getting popular in our group.

A few days ago I also met the same problem described above. Having read the discussion here, the problem has been solved.

One question may be not related to this bug, but essential: have the LINCS phase 2 data (GSE70138) also been included in the database? Thanks!

yduan004 commented 2 years ago

Hi @jha14, thanks a lot for recommending the package to your lab colleagues! It is very appreciated. Unfortunately, the LINCS GSE70138 data is not included in the database, but you could generate your own reference database by referring to the 4.2 Z-scores from GEO section of the signatureSeachData vignette. The good news is that we are working on including the LINCS newest beta 2020 level 5 and level 3 databases into the package, hope it will come soon. Thanks!

jha14 commented 2 years ago

Hello @yduan004, great to hear that the database of the signatureSearch package remain updating. As you said, building a customized database solve my issue. I am looking forward to and will keep an eye on the newest package. Thank you and all the best! Han