saezlab / OmnipathR

R client for the OmniPath web service
https://r.omnipathdb.org/
Other
105 stars 20 forks source link

TIME OUT for import_intercell_network #88

Open howtofindme opened 1 year ago

howtofindme commented 1 year ago

Hi when I run import_intercell_network ,it always throw a time-out. I guess it is a problem of my network. So, can I imort these network in local? could you give me some hints?

Thanks! Young

image

deeenes commented 1 year ago

Hi,

Above we see two different errors from two independent attempts to download the same URL. The first error means the SSL handshake was not completed, your machine was waiting for a packet, sent by our server, that never arrived. The second error happened at a step upstream of the previous one: here your machine asked its DNS server what's the IP address of our server, but the answer has never come. Both errors have one thing in common: a network packet got lost with no trace. It means, either the network your computer is connected to, or a larger network connecting it to the internet is suffering from issues and packets get lost. As you might see, we can not really do anything about this kind of error, but I can give you a few hints:

I hope this helps, please let me know if you've more questions.

Best,

Denes

howtofindme commented 1 year ago

Hi,

Above we see two different errors from two independent attempts to download the same URL. The first error means the SSL handshake was not completed, your machine was waiting for a packet, sent by our server, that never arrived. The second error happened at a step upstream of the previous one: here your machine asked its DNS server what's the IP address of our server, but the answer has never come. Both errors have one thing in common: a network packet got lost with no trace. It means, either the network your computer is connected to, or a larger network connecting it to the internet is suffering from issues and packets get lost. As you might see, we can not really do anything about this kind of error, but I can give you a few hints:

  • Try from another network: from home, from another institute, company, etc.
  • Use different DNS servers, possibly one or more well established public servers
  • Test your setup with curl -vvv: this error is a basic networking issue, and this way you see all the details of the communication
  • Do all your tests a few times, as the errors come randomly
  • Try to download some pages from https://omnipathdb.org/, and also from other domains. Good to try for example a server which is close to you, such as a university in your town, and something that is in an international data centre. Use traceroute and whois to find out what is where and the path of network traffic. Observe what kind of errors pop up in each case.
  • Try an HTTP client different than libcurl: e.g. open the same URLs in a web browser (in this case look at the Network tab of the Inspector for network errors).

I hope this helps, please let me know if you've more questions.

Best,

Denes

Dear Denes, It's a great honor to hear from you. I benefit a lot. I try again by using brower to download your data ,and it works! the link is https://omnipathdb.org/interactions?genesymbols=yes&datasets=ligrecextra,omnipath,pathwayextra&organisms=9606&fields=datasets,sources,references,curation_effort&license=academic

But a new error occurs when I run

Selecting important features

lig_rec_red <- lig_rec %>% dplyr::ungroup() %>% dplyr::select(target_genesymbol,source_genesymbol, is_directed,category_intercell_target)

https://github.com/saezlab/misty_pipelines/blob/0d23e52524375171bd26182892a18fc55b258818/visium/2_run_misty_ppline.R#L30

image

This means there is no "category_intercell_target" column in your data. I dont known whether the file is correct in your server.

Thanks for your help. Best wishes, Young

deeenes commented 1 year ago

Hi Young,

In the OmniPath Interactions database there is no data about intercellular communication roles. Those are stored in our Intercell database: https://omnipathdb.org/queries/intercell. The import_intercell_network in OmnipathR (and also in the Python omnipath module) combines the interactions with the intercellular communication roles to create a cell-cell communication network. As you see in the Visium script that you've linked, lig_rec is the output if this function. If you use the OmniPath Intercell dataset in your work, I recommend to read carefully its description in our paper (also tables EV6 and EV10), and take a look at the quality filtering options. You can also consider this as an alternative.

Overall, I think the better solution to your problem is to fix your original issue with the downloading, and use import_intercell_network.

Best, Denes

howtofindme commented 1 year ago

Hi Young,

In the OmniPath Interactions database there is no data about intercellular communication roles. Those are stored in our Intercell database: https://omnipathdb.org/queries/intercell. The import_intercell_network in OmnipathR (and also in the Python omnipath module) combines the interactions with the intercellular communication roles to create a cell-cell communication network. As you see in the Visium script that you've linked, lig_rec is the output if this function. If you use the OmniPath Intercell dataset in your work, I recommend to read carefully its description in our paper (also tables EV6 and EV10), and take a look at the quality filtering options. You can also consider this as an alternative.

Overall, I think the better solution to your problem is to fix your original issue with the downloading, and use import_intercell_network.

Best, Denes

Dear Denes, Really Thanks!

After using another machine, finally I can download your data.

1.But since I can also download your data using browser from archive.omnipathdb.org, I was wondering whether there is a way that I can annotate proteins using import_omnipath_annotations() through the locally downloaded file in my poor-network machine.

2.Following might be some errors, but I am not sure.

2.1 import_intercell_network() works very well. image

2.2 but curated_ligand_receptor_interactions() does not work. image

2.3 interactions_pathwayextra_mice <- import_pathwayextra_interactions(resources=c("BioGRID","STRING"), organism = 10090) is ok but interactions_pathwayextra_mice_all <- import_pathwayextra_interactions(resources=get_interaction_resources(), organism = 10090) failed

image

image

Best,

Young

sessioninfo::session_info() ─ Session info ────────────────────────────────────────────────────────────────────────────────────────────────── setting value version R version 4.3.1 (2023-06-16) os Ubuntu 20.04.6 LTS system x86_64, linux-gnu ui RStudio language (EN) collate en_US.UTF-8 ctype en_US.UTF-8 tz Asia/Shanghai date 2023-10-11 rstudio 2023.06.2+561 Mountain Hydrangea (server) pandoc 3.1.1 @ /usr/lib/rstudio-server/bin/quarto/bin/tools/ (via rmarkdown)

─ Packages ────────────────────────────────────────────────────────────────────────────────────────────────────── package version date (UTC) lib source abind 1.4-5 2016-07-21 [1] CRAN (R 4.3.1) backports 1.4.1 2021-12-13 [1] CRAN (R 4.3.1) BiocManager 1.30.22 2023-08-08 [1] CRAN (R 4.3.1) bit 4.0.5 2022-11-15 [1] CRAN (R 4.3.1) bit64 4.0.5 2020-08-30 [1] CRAN (R 4.3.1) cachem 1.0.8 2023-05-01 [1] CRAN (R 4.3.1) callr 3.7.3 2022-11-02 [1] CRAN (R 4.3.1) cellranger 1.1.0 2016-07-27 [1] CRAN (R 4.3.1) checkmate 2.2.0 2023-04-27 [1] CRAN (R 4.3.1) cli 3.6.1 2023-03-23 [1] CRAN (R 4.3.1) cluster 2.1.4 2022-08-22 [3] CRAN (R 4.2.1) codetools 0.2-19 2023-02-01 [3] CRAN (R 4.2.2) colorspace 2.1-0 2023-01-23 [1] CRAN (R 4.3.1) cowplot 1.1.1 2020-12-30 [1] CRAN (R 4.3.1) crayon 1.5.2 2022-09-29 [1] CRAN (R 4.3.1) curl 5.0.2 2023-08-14 [1] CRAN (R 4.3.1) data.table 1.14.8 2023-02-17 [1] CRAN (R 4.3.1) deldir 1.0-9 2023-05-17 [1] CRAN (R 4.3.1) desc 1.4.2 2022-09-08 [1] CRAN (R 4.3.1) devtools 2.4.5 2022-10-11 [1] CRAN (R 4.3.1) digest 0.6.33 2023-07-07 [1] CRAN (R 4.3.1) dplyr 1.1.3 2023-09-03 [1] CRAN (R 4.3.1) ellipsis 0.3.2 2021-04-29 [1] CRAN (R 4.3.1) evaluate 0.21 2023-05-05 [1] CRAN (R 4.3.1) fansi 1.0.4 2023-01-22 [1] CRAN (R 4.3.1) fastmap 1.1.1 2023-02-24 [1] CRAN (R 4.3.1) fitdistrplus 1.1-11 2023-04-25 [1] CRAN (R 4.3.1) forcats 1.0.0 2023-01-29 [1] CRAN (R 4.3.1) fs 1.6.3 2023-07-20 [1] CRAN (R 4.3.1) future 1.33.0 2023-07-01 [1] CRAN (R 4.3.1) future.apply 1.11.0 2023-05-21 [1] CRAN (R 4.3.1) generics 0.1.3 2022-07-05 [1] CRAN (R 4.3.1) ggplot2 3.4.3 2023-08-14 [1] CRAN (R 4.3.1) ggrepel 0.9.3 2023-02-03 [1] CRAN (R 4.3.1) ggridges 0.5.4 2022-09-26 [1] CRAN (R 4.3.1) globals 0.16.2 2022-11-21 [1] CRAN (R 4.3.1) glue 1.6.2 2022-02-24 [1] CRAN (R 4.3.1) goftest 1.2-3 2021-10-07 [1] CRAN (R 4.3.1) gridExtra 2.3 2017-09-09 [1] CRAN (R 4.3.1) gtable 0.3.4 2023-08-21 [1] CRAN (R 4.3.1) hms 1.1.3 2023-03-21 [1] CRAN (R 4.3.1) htmltools 0.5.6 2023-08-10 [1] CRAN (R 4.3.1) htmlwidgets 1.6.2 2023-03-17 [1] CRAN (R 4.3.1) httpuv 1.6.11 2023-05-11 [1] CRAN (R 4.3.1) httr 1.4.7 2023-08-15 [1] CRAN (R 4.3.1) ica 1.0-3 2022-07-08 [1] CRAN (R 4.3.1) igraph 1.5.1 2023-08-10 [1] CRAN (R 4.3.1) irlba 2.3.5.1 2022-10-03 [1] CRAN (R 4.3.1) jsonlite 1.8.7 2023-06-29 [1] CRAN (R 4.3.1) KernSmooth 2.23-22 2023-07-10 [3] CRAN (R 4.3.1) knitr 1.43 2023-05-25 [1] CRAN (R 4.3.1) later 1.3.1 2023-05-02 [1] CRAN (R 4.3.1) lattice 0.21-8 2023-04-05 [3] CRAN (R 4.3.0) lazyeval 0.2.2 2019-03-15 [1] CRAN (R 4.3.1) leiden 0.4.3 2022-09-10 [1] CRAN (R 4.3.1) lifecycle 1.0.3 2022-10-07 [1] CRAN (R 4.3.1) listenv 0.9.0 2022-12-16 [1] CRAN (R 4.3.1) lmtest 0.9-40 2022-03-21 [1] CRAN (R 4.3.1) logger 0.2.2 2021-10-19 [1] CRAN (R 4.3.1) lubridate 1.9.2 2023-02-10 [1] CRAN (R 4.3.1) magrittr 2.0.3 2022-03-30 [1] CRAN (R 4.3.1) MASS 7.3-60 2023-05-04 [3] CRAN (R 4.3.1) Matrix 1.6-1 2023-08-14 [3] CRAN (R 4.3.1) matrixStats 1.0.0 2023-06-02 [1] CRAN (R 4.3.1) memoise 2.0.1 2021-11-26 [1] CRAN (R 4.3.1) mime 0.12 2021-09-28 [1] CRAN (R 4.3.1) miniUI 0.1.1.1 2018-05-18 [1] CRAN (R 4.3.1) munsell 0.5.0 2018-06-12 [1] CRAN (R 4.3.1) nlme 3.1-163 2023-08-09 [3] CRAN (R 4.3.1) OmnipathR 3.9.8 2023-10-11 [1] Github (saezlab/OmnipathR@f72c23b) parallelly 1.36.0 2023-05-26 [1] CRAN (R 4.3.1) patchwork 1.1.3 2023-08-14 [1] CRAN (R 4.3.1) pbapply 1.7-2 2023-06-27 [1] CRAN (R 4.3.1) pillar 1.9.0 2023-03-22 [1] CRAN (R 4.3.1) pkgbuild 1.4.2 2023-06-26 [1] CRAN (R 4.3.1) pkgconfig 2.0.3 2019-09-22 [1] CRAN (R 4.3.1) pkgload 1.3.2.1 2023-07-08 [1] CRAN (R 4.3.1) plotly 4.10.2 2023-06-03 [1] CRAN (R 4.3.1) plyr 1.8.8 2022-11-11 [1] CRAN (R 4.3.1) png 0.1-8 2022-11-29 [1] CRAN (R 4.3.1) polyclip 1.10-4 2022-10-20 [1] CRAN (R 4.3.1) prettyunits 1.1.1 2020-01-24 [1] CRAN (R 4.3.1) processx 3.8.2 2023-06-30 [1] CRAN (R 4.3.1) profvis 0.3.8 2023-05-02 [1] CRAN (R 4.3.1) progress 1.2.2 2019-05-16 [1] CRAN (R 4.3.1) progressr 0.14.0 2023-08-10 [1] CRAN (R 4.3.1) promises 1.2.1 2023-08-10 [1] CRAN (R 4.3.1) ps 1.7.5 2023-04-18 [1] CRAN (R 4.3.1) purrr 1.0.2 2023-08-10 [1] CRAN (R 4.3.1) R6 2.5.1 2021-08-19 [1] CRAN (R 4.3.1) RANN 2.6.1 2019-01-08 [1] CRAN (R 4.3.1) rappdirs 0.3.3 2021-01-31 [1] CRAN (R 4.3.1) RColorBrewer 1.1-3 2022-04-03 [1] CRAN (R 4.3.1) Rcpp 1.0.11 2023-07-06 [1] CRAN (R 4.3.1) RcppAnnoy 0.0.21 2023-07-02 [1] CRAN (R 4.3.1) readr 2.1.4 2023-02-10 [1] CRAN (R 4.3.1) readxl 1.4.3 2023-07-06 [1] CRAN (R 4.3.1) remotes 2.4.2.1 2023-07-18 [1] CRAN (R 4.3.1) reshape2 1.4.4 2020-04-09 [1] CRAN (R 4.3.1) reticulate 1.31 2023-08-10 [1] CRAN (R 4.3.1) rlang 1.1.1 2023-04-28 [1] CRAN (R 4.3.1) rmarkdown 2.24 2023-08-14 [1] CRAN (R 4.3.1) ROCR 1.0-11 2020-05-02 [1] CRAN (R 4.3.1) rprojroot 2.0.3 2022-04-02 [1] CRAN (R 4.3.1) rstudioapi 0.15.0 2023-07-07 [1] CRAN (R 4.3.1) Rtsne 0.16 2022-04-17 [1] CRAN (R 4.3.1) rvest 1.0.3 2022-08-19 [1] CRAN (R 4.3.1) scales 1.2.1 2022-08-20 [1] CRAN (R 4.3.1) scattermore 1.2 2023-06-12 [1] CRAN (R 4.3.1) sctransform 0.3.5 2022-09-21 [1] CRAN (R 4.3.1) selectr 0.4-2 2019-11-20 [1] CRAN (R 4.3.1) sessioninfo 1.2.2 2021-12-06 [1] CRAN (R 4.3.1) Seurat 4.3.0.1 2023-06-22 [1] CRAN (R 4.3.1) SeuratObject 4.1.3 2022-11-07 [1] CRAN (R 4.3.1) shiny 1.7.5 2023-08-12 [1] CRAN (R 4.3.1) sp 2.0-0 2023-06-22 [1] CRAN (R 4.3.1) spatstat.data 3.0-1 2023-03-12 [1] CRAN (R 4.3.1) spatstat.explore 3.2-3 2023-09-07 [1] CRAN (R 4.3.1) spatstat.geom 3.2-5 2023-09-05 [1] CRAN (R 4.3.1) spatstat.random 3.1-5 2023-05-11 [1] CRAN (R 4.3.1) spatstat.sparse 3.0-2 2023-06-25 [1] CRAN (R 4.3.1) spatstat.utils 3.0-3 2023-05-09 [1] CRAN (R 4.3.1) stringi 1.7.12 2023-01-11 [1] CRAN (R 4.3.1) stringr 1.5.0 2022-12-02 [1] CRAN (R 4.3.1) survival 3.5-7 2023-08-14 [3] CRAN (R 4.3.1) tensor 1.5 2012-05-05 [1] CRAN (R 4.3.1) tibble 3.2.1 2023-03-20 [1] CRAN (R 4.3.1) tidyr 1.3.0 2023-01-24 [1] CRAN (R 4.3.1) tidyselect 1.2.0 2022-10-10 [1] CRAN (R 4.3.1) tidyverse 2.0.0 2023-02-22 [1] CRAN (R 4.3.1) timechange 0.2.0 2023-01-11 [1] CRAN (R 4.3.1) tzdb 0.4.0 2023-05-12 [1] CRAN (R 4.3.1) urlchecker 1.0.1 2021-11-30 [1] CRAN (R 4.3.1) usethis 2.2.2 2023-07-06 [1] CRAN (R 4.3.1) utf8 1.2.3 2023-01-31 [1] CRAN (R 4.3.1) uwot 0.1.16 2023-06-29 [1] CRAN (R 4.3.1) vctrs 0.6.3 2023-06-14 [1] CRAN (R 4.3.1) viridisLite 0.4.2 2023-05-02 [1] CRAN (R 4.3.1) vroom 1.6.3 2023-04-28 [1] CRAN (R 4.3.1) withr 2.5.0 2022-03-03 [1] CRAN (R 4.3.1) xfun 0.40 2023-08-09 [1] CRAN (R 4.3.1) xml2 1.3.5 2023-07-06 [1] CRAN (R 4.3.1) xtable 1.8-4 2019-04-21 [1] CRAN (R 4.3.1) yaml 2.3.7 2023-01-23 [1] CRAN (R 4.3.1) zoo 1.8-12 2023-04-13 [1] CRAN (R 4.3.1)

[1] /usr/local/lib/R/site-library [2] /usr/lib/R/site-library [3] /usr/lib/R/library

image

deeenes commented 1 year ago

Hello Young,

Dear Denes, Really Thanks!

After using another machine, finally I can download your data.

1.But since I can also download your data using browser from archive.omnipathdb.org, I was wondering whether there is a way that I can annotate proteins using import_omnipath_annotations() through the locally downloaded file in my poor-network machine.

Technically it's possible, but then you have to write quite some code that is already written in the OmnipathR package. It would be time consuming and error prone. All this because of a poor network. If I had no other choice than dealing with that network, I would start with recording some curl debug logs to find out what's going on, why the network transactions fail. Otherwise far the easiest option for you is to get access to a good network.

Also, OmnipathR stores the downloaded data in its local cache, so once you downloaded everything in your script, no network transactions are necessary (there might be a few exceptions).

2.Following might be some errors, but I am not sure.

2.1 import_intercell_network() works very well. image

Yes, this worked well, but the warning message is still worrying: it means that some unexpected type of value was encountered when processing the data, and this shouldn't happen. Maybe it's also a networking error, and one of the responses was not fully transmitted. You can wipe the cache directory and try again.

library(OmnipathR)
omnipath_cache_wipe()

You can also inspect the resulted data frame if all columns and their types look alright. To do this, simply print the data frame to the terminal.

2.2 but curated_ligand_receptor_interactions() does not work. image

This is again a download error, and I'm sure this download has been performed successfully in many of your earlier calls. It's likely just by accident, it makes sense to try again a few times. This file (https://omnipathdb.org/resources) is downloaded by jsonlite::fromJSON, which uses curl as its HTTP backend, so you can investigate by curl debug logs.

2.3 interactions_pathwayextra_mice <- import_pathwayextra_interactions(resources=c("BioGRID","STRING"), organism = 10090) is ok

It's not okay, it returned 0 interactions :) I don't think it makes sense to pass get_interaction_resources() to import_pathwayextra_interactions: the former returns all interaction resources (including TF, miRNA and small molecule interactions), while pathwayextra itself is already a set of resources. If you don't want some of those, use the exclude parameter, if you only want some of them, list them in the resources parameter.

but interactions_pathwayextra_mice_all <- import_pathwayextra_interactions(resources=get_interaction_resources(), organism = 10090) failed

It hasn't failed, it only sent a warning But indeed, STRING is not redistributed in OmniPath, and while we have some interactions annotated from BioGRID, I wouldn't recommend accessing specifically BioGRID by OmniPath: most of its content is not included in our data, as it consists of undirected interactions from large screens.

Best,

Young

sessioninfo::session_info() ─ Session info ────────────────────────────────────────────────────────────────────────────────────────────────── setting value version R version 4.3.1 (2023-06-16) os Ubuntu 20.04.6 LTS system x86_64, linux-gnu ui RStudio language (EN) collate en_US.UTF-8 ctype en_US.UTF-8 tz Asia/Shanghai date 2023-10-11 rstudio 2023.06.2+561 Mountain Hydrangea (server) pandoc 3.1.1 @ /usr/lib/rstudio-server/bin/quarto/bin/tools/ (via rmarkdown)

─ Packages ────────────────────────────────────────────────────────────────────────────────────────────────────── package version date (UTC) lib source abind 1.4-5 2016-07-21 [1] CRAN (R 4.3.1) backports 1.4.1 2021-12-13 [1] CRAN (R 4.3.1) BiocManager 1.30.22 2023-08-08 [1] CRAN (R 4.3.1) bit 4.0.5 2022-11-15 [1] CRAN (R 4.3.1) bit64 4.0.5 2020-08-30 [1] CRAN (R 4.3.1) cachem 1.0.8 2023-05-01 [1] CRAN (R 4.3.1) callr 3.7.3 2022-11-02 [1] CRAN (R 4.3.1) cellranger 1.1.0 2016-07-27 [1] CRAN (R 4.3.1) checkmate 2.2.0 2023-04-27 [1] CRAN (R 4.3.1) cli 3.6.1 2023-03-23 [1] CRAN (R 4.3.1) cluster 2.1.4 2022-08-22 [3] CRAN (R 4.2.1) codetools 0.2-19 2023-02-01 [3] CRAN (R 4.2.2) colorspace 2.1-0 2023-01-23 [1] CRAN (R 4.3.1) cowplot 1.1.1 2020-12-30 [1] CRAN (R 4.3.1) crayon 1.5.2 2022-09-29 [1] CRAN (R 4.3.1) curl 5.0.2 2023-08-14 [1] CRAN (R 4.3.1) data.table 1.14.8 2023-02-17 [1] CRAN (R 4.3.1) deldir 1.0-9 2023-05-17 [1] CRAN (R 4.3.1) desc 1.4.2 2022-09-08 [1] CRAN (R 4.3.1) devtools 2.4.5 2022-10-11 [1] CRAN (R 4.3.1) digest 0.6.33 2023-07-07 [1] CRAN (R 4.3.1) dplyr 1.1.3 2023-09-03 [1] CRAN (R 4.3.1) ellipsis 0.3.2 2021-04-29 [1] CRAN (R 4.3.1) evaluate 0.21 2023-05-05 [1] CRAN (R 4.3.1) fansi 1.0.4 2023-01-22 [1] CRAN (R 4.3.1) fastmap 1.1.1 2023-02-24 [1] CRAN (R 4.3.1) fitdistrplus 1.1-11 2023-04-25 [1] CRAN (R 4.3.1) forcats 1.0.0 2023-01-29 [1] CRAN (R 4.3.1) fs 1.6.3 2023-07-20 [1] CRAN (R 4.3.1) future 1.33.0 2023-07-01 [1] CRAN (R 4.3.1) future.apply 1.11.0 2023-05-21 [1] CRAN (R 4.3.1) generics 0.1.3 2022-07-05 [1] CRAN (R 4.3.1) ggplot2 3.4.3 2023-08-14 [1] CRAN (R 4.3.1) ggrepel 0.9.3 2023-02-03 [1] CRAN (R 4.3.1) ggridges 0.5.4 2022-09-26 [1] CRAN (R 4.3.1) globals 0.16.2 2022-11-21 [1] CRAN (R 4.3.1) glue 1.6.2 2022-02-24 [1] CRAN (R 4.3.1) goftest 1.2-3 2021-10-07 [1] CRAN (R 4.3.1) gridExtra 2.3 2017-09-09 [1] CRAN (R 4.3.1) gtable 0.3.4 2023-08-21 [1] CRAN (R 4.3.1) hms 1.1.3 2023-03-21 [1] CRAN (R 4.3.1) htmltools 0.5.6 2023-08-10 [1] CRAN (R 4.3.1) htmlwidgets 1.6.2 2023-03-17 [1] CRAN (R 4.3.1) httpuv 1.6.11 2023-05-11 [1] CRAN (R 4.3.1) httr 1.4.7 2023-08-15 [1] CRAN (R 4.3.1) ica 1.0-3 2022-07-08 [1] CRAN (R 4.3.1) igraph 1.5.1 2023-08-10 [1] CRAN (R 4.3.1) irlba 2.3.5.1 2022-10-03 [1] CRAN (R 4.3.1) jsonlite 1.8.7 2023-06-29 [1] CRAN (R 4.3.1) KernSmooth 2.23-22 2023-07-10 [3] CRAN (R 4.3.1) knitr 1.43 2023-05-25 [1] CRAN (R 4.3.1) later 1.3.1 2023-05-02 [1] CRAN (R 4.3.1) lattice 0.21-8 2023-04-05 [3] CRAN (R 4.3.0) lazyeval 0.2.2 2019-03-15 [1] CRAN (R 4.3.1) leiden 0.4.3 2022-09-10 [1] CRAN (R 4.3.1) lifecycle 1.0.3 2022-10-07 [1] CRAN (R 4.3.1) listenv 0.9.0 2022-12-16 [1] CRAN (R 4.3.1) lmtest 0.9-40 2022-03-21 [1] CRAN (R 4.3.1) logger 0.2.2 2021-10-19 [1] CRAN (R 4.3.1) lubridate 1.9.2 2023-02-10 [1] CRAN (R 4.3.1) magrittr 2.0.3 2022-03-30 [1] CRAN (R 4.3.1) MASS 7.3-60 2023-05-04 [3] CRAN (R 4.3.1) Matrix 1.6-1 2023-08-14 [3] CRAN (R 4.3.1) matrixStats 1.0.0 2023-06-02 [1] CRAN (R 4.3.1) memoise 2.0.1 2021-11-26 [1] CRAN (R 4.3.1) mime 0.12 2021-09-28 [1] CRAN (R 4.3.1) miniUI 0.1.1.1 2018-05-18 [1] CRAN (R 4.3.1) munsell 0.5.0 2018-06-12 [1] CRAN (R 4.3.1) nlme 3.1-163 2023-08-09 [3] CRAN (R 4.3.1) OmnipathR 3.9.8 2023-10-11 [1] Github (f72c23b) parallelly 1.36.0 2023-05-26 [1] CRAN (R 4.3.1) patchwork 1.1.3 2023-08-14 [1] CRAN (R 4.3.1) pbapply 1.7-2 2023-06-27 [1] CRAN (R 4.3.1) pillar 1.9.0 2023-03-22 [1] CRAN (R 4.3.1) pkgbuild 1.4.2 2023-06-26 [1] CRAN (R 4.3.1) pkgconfig 2.0.3 2019-09-22 [1] CRAN (R 4.3.1) pkgload 1.3.2.1 2023-07-08 [1] CRAN (R 4.3.1) plotly 4.10.2 2023-06-03 [1] CRAN (R 4.3.1) plyr 1.8.8 2022-11-11 [1] CRAN (R 4.3.1) png 0.1-8 2022-11-29 [1] CRAN (R 4.3.1) polyclip 1.10-4 2022-10-20 [1] CRAN (R 4.3.1) prettyunits 1.1.1 2020-01-24 [1] CRAN (R 4.3.1) processx 3.8.2 2023-06-30 [1] CRAN (R 4.3.1) profvis 0.3.8 2023-05-02 [1] CRAN (R 4.3.1) progress 1.2.2 2019-05-16 [1] CRAN (R 4.3.1) progressr 0.14.0 2023-08-10 [1] CRAN (R 4.3.1) promises 1.2.1 2023-08-10 [1] CRAN (R 4.3.1) ps 1.7.5 2023-04-18 [1] CRAN (R 4.3.1) purrr 1.0.2 2023-08-10 [1] CRAN (R 4.3.1) R6 2.5.1 2021-08-19 [1] CRAN (R 4.3.1) RANN 2.6.1 2019-01-08 [1] CRAN (R 4.3.1) rappdirs 0.3.3 2021-01-31 [1] CRAN (R 4.3.1) RColorBrewer 1.1-3 2022-04-03 [1] CRAN (R 4.3.1) Rcpp 1.0.11 2023-07-06 [1] CRAN (R 4.3.1) RcppAnnoy 0.0.21 2023-07-02 [1] CRAN (R 4.3.1) readr 2.1.4 2023-02-10 [1] CRAN (R 4.3.1) readxl 1.4.3 2023-07-06 [1] CRAN (R 4.3.1) remotes 2.4.2.1 2023-07-18 [1] CRAN (R 4.3.1) reshape2 1.4.4 2020-04-09 [1] CRAN (R 4.3.1) reticulate 1.31 2023-08-10 [1] CRAN (R 4.3.1) rlang 1.1.1 2023-04-28 [1] CRAN (R 4.3.1) rmarkdown 2.24 2023-08-14 [1] CRAN (R 4.3.1) ROCR 1.0-11 2020-05-02 [1] CRAN (R 4.3.1) rprojroot 2.0.3 2022-04-02 [1] CRAN (R 4.3.1) rstudioapi 0.15.0 2023-07-07 [1] CRAN (R 4.3.1) Rtsne 0.16 2022-04-17 [1] CRAN (R 4.3.1) rvest 1.0.3 2022-08-19 [1] CRAN (R 4.3.1) scales 1.2.1 2022-08-20 [1] CRAN (R 4.3.1) scattermore 1.2 2023-06-12 [1] CRAN (R 4.3.1) sctransform 0.3.5 2022-09-21 [1] CRAN (R 4.3.1) selectr 0.4-2 2019-11-20 [1] CRAN (R 4.3.1) sessioninfo 1.2.2 2021-12-06 [1] CRAN (R 4.3.1) Seurat 4.3.0.1 2023-06-22 [1] CRAN (R 4.3.1) SeuratObject 4.1.3 2022-11-07 [1] CRAN (R 4.3.1) shiny 1.7.5 2023-08-12 [1] CRAN (R 4.3.1) sp 2.0-0 2023-06-22 [1] CRAN (R 4.3.1) spatstat.data 3.0-1 2023-03-12 [1] CRAN (R 4.3.1) spatstat.explore 3.2-3 2023-09-07 [1] CRAN (R 4.3.1) spatstat.geom 3.2-5 2023-09-05 [1] CRAN (R 4.3.1) spatstat.random 3.1-5 2023-05-11 [1] CRAN (R 4.3.1) spatstat.sparse 3.0-2 2023-06-25 [1] CRAN (R 4.3.1) spatstat.utils 3.0-3 2023-05-09 [1] CRAN (R 4.3.1) stringi 1.7.12 2023-01-11 [1] CRAN (R 4.3.1) stringr 1.5.0 2022-12-02 [1] CRAN (R 4.3.1) survival 3.5-7 2023-08-14 [3] CRAN (R 4.3.1) tensor 1.5 2012-05-05 [1] CRAN (R 4.3.1) tibble 3.2.1 2023-03-20 [1] CRAN (R 4.3.1) tidyr 1.3.0 2023-01-24 [1] CRAN (R 4.3.1) tidyselect 1.2.0 2022-10-10 [1] CRAN (R 4.3.1) tidyverse 2.0.0 2023-02-22 [1] CRAN (R 4.3.1) timechange 0.2.0 2023-01-11 [1] CRAN (R 4.3.1) tzdb 0.4.0 2023-05-12 [1] CRAN (R 4.3.1) urlchecker 1.0.1 2021-11-30 [1] CRAN (R 4.3.1) usethis 2.2.2 2023-07-06 [1] CRAN (R 4.3.1) utf8 1.2.3 2023-01-31 [1] CRAN (R 4.3.1) uwot 0.1.16 2023-06-29 [1] CRAN (R 4.3.1) vctrs 0.6.3 2023-06-14 [1] CRAN (R 4.3.1) viridisLite 0.4.2 2023-05-02 [1] CRAN (R 4.3.1) vroom 1.6.3 2023-04-28 [1] CRAN (R 4.3.1) withr 2.5.0 2022-03-03 [1] CRAN (R 4.3.1) xfun 0.40 2023-08-09 [1] CRAN (R 4.3.1) xml2 1.3.5 2023-07-06 [1] CRAN (R 4.3.1) xtable 1.8-4 2019-04-21 [1] CRAN (R 4.3.1) yaml 2.3.7 2023-01-23 [1] CRAN (R 4.3.1) zoo 1.8-12 2023-04-13 [1] CRAN (R 4.3.1)

[1] /usr/local/lib/R/site-library [2] /usr/lib/R/site-library [3] /usr/lib/R/library

image

Thanks for the session info, it's good to see that packages are up to date and you're using Linux. Btw, instead of inserting pictures, you can copy-paste the text in code blocks by using triple backticks.

Best, Denes

howtofindme commented 1 year ago

Hello Young,

Dear Denes, Really Thanks! After using another machine, finally I can download your data. 1.But since I can also download your data using browser from archive.omnipathdb.org, I was wondering whether there is a way that I can annotate proteins using import_omnipath_annotations() through the locally downloaded file in my poor-network machine.

Technically it's possible, but then you have to write quite some code that is already written in the OmnipathR package. It would be time consuming and error prone. All this because of a poor network. If I had no other choice than dealing with that network, I would start with recording some curl debug logs to find out what's going on, why the network transactions fail. Otherwise far the easiest option for you is to get access to a good network.

Also, OmnipathR stores the downloaded data in its local cache, so once you downloaded everything in your script, no network transactions are necessary (there might be a few exceptions).

2.Following might be some errors, but I am not sure. 2.1 import_intercell_network() works very well. image

Yes, this worked well, but the warning message is still worrying: it means that some unexpected type of value was encountered when processing the data, and this shouldn't happen. Maybe it's also a networking error, and one of the responses was not fully transmitted. You can wipe the cache directory and try again.

library(OmnipathR)
omnipath_cache_wipe()

You can also inspect the resulted data frame if all columns and their types look alright. To do this, simply print the data frame to the terminal.

2.2 but curated_ligand_receptor_interactions() does not work. image

This is again a download error, and I'm sure this download has been performed successfully in many of your earlier calls. It's likely just by accident, it makes sense to try again a few times. This file (https://omnipathdb.org/resources) is downloaded by jsonlite::fromJSON, which uses curl as its HTTP backend, so you can investigate by curl debug logs.

2.3 interactions_pathwayextra_mice <- import_pathwayextra_interactions(resources=c("BioGRID","STRING"), organism = 10090) is ok

It's not okay, it returned 0 interactions :) I don't think it makes sense to pass get_interaction_resources() to import_pathwayextra_interactions: the former returns all interaction resources (including TF, miRNA and small molecule interactions), while pathwayextra itself is already a set of resources. If you don't want some of those, use the exclude parameter, if you only want some of them, list them in the resources parameter.

but interactions_pathwayextra_mice_all <- import_pathwayextra_interactions(resources=get_interaction_resources(), organism = 10090) failed

It hasn't failed, it only sent a warning But indeed, STRING is not redistributed in OmniPath, and while we have some interactions annotated from BioGRID, I wouldn't recommend accessing specifically BioGRID by OmniPath: most of its content is not included in our data, as it consists of undirected interactions from large screens.

Best, Young sessioninfo::session_info() ─ Session info ────────────────────────────────────────────────────────────────────────────────────────────────── setting value version R version 4.3.1 (2023-06-16) os Ubuntu 20.04.6 LTS system x86_64, linux-gnu ui RStudio language (EN) collate en_US.UTF-8 ctype en_US.UTF-8 tz Asia/Shanghai date 2023-10-11 rstudio 2023.06.2+561 Mountain Hydrangea (server) pandoc 3.1.1 @ /usr/lib/rstudio-server/bin/quarto/bin/tools/ (via rmarkdown) ─ Packages ────────────────────────────────────────────────────────────────────────────────────────────────────── package version date (UTC) lib source abind 1.4-5 2016-07-21 [1] CRAN (R 4.3.1) backports 1.4.1 2021-12-13 [1] CRAN (R 4.3.1) BiocManager 1.30.22 2023-08-08 [1] CRAN (R 4.3.1) bit 4.0.5 2022-11-15 [1] CRAN (R 4.3.1) bit64 4.0.5 2020-08-30 [1] CRAN (R 4.3.1) cachem 1.0.8 2023-05-01 [1] CRAN (R 4.3.1) callr 3.7.3 2022-11-02 [1] CRAN (R 4.3.1) cellranger 1.1.0 2016-07-27 [1] CRAN (R 4.3.1) checkmate 2.2.0 2023-04-27 [1] CRAN (R 4.3.1) cli 3.6.1 2023-03-23 [1] CRAN (R 4.3.1) cluster 2.1.4 2022-08-22 [3] CRAN (R 4.2.1) codetools 0.2-19 2023-02-01 [3] CRAN (R 4.2.2) colorspace 2.1-0 2023-01-23 [1] CRAN (R 4.3.1) cowplot 1.1.1 2020-12-30 [1] CRAN (R 4.3.1) crayon 1.5.2 2022-09-29 [1] CRAN (R 4.3.1) curl 5.0.2 2023-08-14 [1] CRAN (R 4.3.1) data.table 1.14.8 2023-02-17 [1] CRAN (R 4.3.1) deldir 1.0-9 2023-05-17 [1] CRAN (R 4.3.1) desc 1.4.2 2022-09-08 [1] CRAN (R 4.3.1) devtools 2.4.5 2022-10-11 [1] CRAN (R 4.3.1) digest 0.6.33 2023-07-07 [1] CRAN (R 4.3.1) dplyr 1.1.3 2023-09-03 [1] CRAN (R 4.3.1) ellipsis 0.3.2 2021-04-29 [1] CRAN (R 4.3.1) evaluate 0.21 2023-05-05 [1] CRAN (R 4.3.1) fansi 1.0.4 2023-01-22 [1] CRAN (R 4.3.1) fastmap 1.1.1 2023-02-24 [1] CRAN (R 4.3.1) fitdistrplus 1.1-11 2023-04-25 [1] CRAN (R 4.3.1) forcats 1.0.0 2023-01-29 [1] CRAN (R 4.3.1) fs 1.6.3 2023-07-20 [1] CRAN (R 4.3.1) future 1.33.0 2023-07-01 [1] CRAN (R 4.3.1) future.apply 1.11.0 2023-05-21 [1] CRAN (R 4.3.1) generics 0.1.3 2022-07-05 [1] CRAN (R 4.3.1) ggplot2 3.4.3 2023-08-14 [1] CRAN (R 4.3.1) ggrepel 0.9.3 2023-02-03 [1] CRAN (R 4.3.1) ggridges 0.5.4 2022-09-26 [1] CRAN (R 4.3.1) globals 0.16.2 2022-11-21 [1] CRAN (R 4.3.1) glue 1.6.2 2022-02-24 [1] CRAN (R 4.3.1) goftest 1.2-3 2021-10-07 [1] CRAN (R 4.3.1) gridExtra 2.3 2017-09-09 [1] CRAN (R 4.3.1) gtable 0.3.4 2023-08-21 [1] CRAN (R 4.3.1) hms 1.1.3 2023-03-21 [1] CRAN (R 4.3.1) htmltools 0.5.6 2023-08-10 [1] CRAN (R 4.3.1) htmlwidgets 1.6.2 2023-03-17 [1] CRAN (R 4.3.1) httpuv 1.6.11 2023-05-11 [1] CRAN (R 4.3.1) httr 1.4.7 2023-08-15 [1] CRAN (R 4.3.1) ica 1.0-3 2022-07-08 [1] CRAN (R 4.3.1) igraph 1.5.1 2023-08-10 [1] CRAN (R 4.3.1) irlba 2.3.5.1 2022-10-03 [1] CRAN (R 4.3.1) jsonlite 1.8.7 2023-06-29 [1] CRAN (R 4.3.1) KernSmooth 2.23-22 2023-07-10 [3] CRAN (R 4.3.1) knitr 1.43 2023-05-25 [1] CRAN (R 4.3.1) later 1.3.1 2023-05-02 [1] CRAN (R 4.3.1) lattice 0.21-8 2023-04-05 [3] CRAN (R 4.3.0) lazyeval 0.2.2 2019-03-15 [1] CRAN (R 4.3.1) leiden 0.4.3 2022-09-10 [1] CRAN (R 4.3.1) lifecycle 1.0.3 2022-10-07 [1] CRAN (R 4.3.1) listenv 0.9.0 2022-12-16 [1] CRAN (R 4.3.1) lmtest 0.9-40 2022-03-21 [1] CRAN (R 4.3.1) logger 0.2.2 2021-10-19 [1] CRAN (R 4.3.1) lubridate 1.9.2 2023-02-10 [1] CRAN (R 4.3.1) magrittr 2.0.3 2022-03-30 [1] CRAN (R 4.3.1) MASS 7.3-60 2023-05-04 [3] CRAN (R 4.3.1) Matrix 1.6-1 2023-08-14 [3] CRAN (R 4.3.1) matrixStats 1.0.0 2023-06-02 [1] CRAN (R 4.3.1) memoise 2.0.1 2021-11-26 [1] CRAN (R 4.3.1) mime 0.12 2021-09-28 [1] CRAN (R 4.3.1) miniUI 0.1.1.1 2018-05-18 [1] CRAN (R 4.3.1) munsell 0.5.0 2018-06-12 [1] CRAN (R 4.3.1) nlme 3.1-163 2023-08-09 [3] CRAN (R 4.3.1) OmnipathR 3.9.8 2023-10-11 [1] Github (f72c23b) parallelly 1.36.0 2023-05-26 [1] CRAN (R 4.3.1) patchwork 1.1.3 2023-08-14 [1] CRAN (R 4.3.1) pbapply 1.7-2 2023-06-27 [1] CRAN (R 4.3.1) pillar 1.9.0 2023-03-22 [1] CRAN (R 4.3.1) pkgbuild 1.4.2 2023-06-26 [1] CRAN (R 4.3.1) pkgconfig 2.0.3 2019-09-22 [1] CRAN (R 4.3.1) pkgload 1.3.2.1 2023-07-08 [1] CRAN (R 4.3.1) plotly 4.10.2 2023-06-03 [1] CRAN (R 4.3.1) plyr 1.8.8 2022-11-11 [1] CRAN (R 4.3.1) png 0.1-8 2022-11-29 [1] CRAN (R 4.3.1) polyclip 1.10-4 2022-10-20 [1] CRAN (R 4.3.1) prettyunits 1.1.1 2020-01-24 [1] CRAN (R 4.3.1) processx 3.8.2 2023-06-30 [1] CRAN (R 4.3.1) profvis 0.3.8 2023-05-02 [1] CRAN (R 4.3.1) progress 1.2.2 2019-05-16 [1] CRAN (R 4.3.1) progressr 0.14.0 2023-08-10 [1] CRAN (R 4.3.1) promises 1.2.1 2023-08-10 [1] CRAN (R 4.3.1) ps 1.7.5 2023-04-18 [1] CRAN (R 4.3.1) purrr 1.0.2 2023-08-10 [1] CRAN (R 4.3.1) R6 2.5.1 2021-08-19 [1] CRAN (R 4.3.1) RANN 2.6.1 2019-01-08 [1] CRAN (R 4.3.1) rappdirs 0.3.3 2021-01-31 [1] CRAN (R 4.3.1) RColorBrewer 1.1-3 2022-04-03 [1] CRAN (R 4.3.1) Rcpp 1.0.11 2023-07-06 [1] CRAN (R 4.3.1) RcppAnnoy 0.0.21 2023-07-02 [1] CRAN (R 4.3.1) readr 2.1.4 2023-02-10 [1] CRAN (R 4.3.1) readxl 1.4.3 2023-07-06 [1] CRAN (R 4.3.1) remotes 2.4.2.1 2023-07-18 [1] CRAN (R 4.3.1) reshape2 1.4.4 2020-04-09 [1] CRAN (R 4.3.1) reticulate 1.31 2023-08-10 [1] CRAN (R 4.3.1) rlang 1.1.1 2023-04-28 [1] CRAN (R 4.3.1) rmarkdown 2.24 2023-08-14 [1] CRAN (R 4.3.1) ROCR 1.0-11 2020-05-02 [1] CRAN (R 4.3.1) rprojroot 2.0.3 2022-04-02 [1] CRAN (R 4.3.1) rstudioapi 0.15.0 2023-07-07 [1] CRAN (R 4.3.1) Rtsne 0.16 2022-04-17 [1] CRAN (R 4.3.1) rvest 1.0.3 2022-08-19 [1] CRAN (R 4.3.1) scales 1.2.1 2022-08-20 [1] CRAN (R 4.3.1) scattermore 1.2 2023-06-12 [1] CRAN (R 4.3.1) sctransform 0.3.5 2022-09-21 [1] CRAN (R 4.3.1) selectr 0.4-2 2019-11-20 [1] CRAN (R 4.3.1) sessioninfo 1.2.2 2021-12-06 [1] CRAN (R 4.3.1) Seurat 4.3.0.1 2023-06-22 [1] CRAN (R 4.3.1) SeuratObject 4.1.3 2022-11-07 [1] CRAN (R 4.3.1) shiny 1.7.5 2023-08-12 [1] CRAN (R 4.3.1) sp 2.0-0 2023-06-22 [1] CRAN (R 4.3.1) spatstat.data 3.0-1 2023-03-12 [1] CRAN (R 4.3.1) spatstat.explore 3.2-3 2023-09-07 [1] CRAN (R 4.3.1) spatstat.geom 3.2-5 2023-09-05 [1] CRAN (R 4.3.1) spatstat.random 3.1-5 2023-05-11 [1] CRAN (R 4.3.1) spatstat.sparse 3.0-2 2023-06-25 [1] CRAN (R 4.3.1) spatstat.utils 3.0-3 2023-05-09 [1] CRAN (R 4.3.1) stringi 1.7.12 2023-01-11 [1] CRAN (R 4.3.1) stringr 1.5.0 2022-12-02 [1] CRAN (R 4.3.1) survival 3.5-7 2023-08-14 [3] CRAN (R 4.3.1) tensor 1.5 2012-05-05 [1] CRAN (R 4.3.1) tibble 3.2.1 2023-03-20 [1] CRAN (R 4.3.1) tidyr 1.3.0 2023-01-24 [1] CRAN (R 4.3.1) tidyselect 1.2.0 2022-10-10 [1] CRAN (R 4.3.1) tidyverse 2.0.0 2023-02-22 [1] CRAN (R 4.3.1) timechange 0.2.0 2023-01-11 [1] CRAN (R 4.3.1) tzdb 0.4.0 2023-05-12 [1] CRAN (R 4.3.1) urlchecker 1.0.1 2021-11-30 [1] CRAN (R 4.3.1) usethis 2.2.2 2023-07-06 [1] CRAN (R 4.3.1) utf8 1.2.3 2023-01-31 [1] CRAN (R 4.3.1) uwot 0.1.16 2023-06-29 [1] CRAN (R 4.3.1) vctrs 0.6.3 2023-06-14 [1] CRAN (R 4.3.1) viridisLite 0.4.2 2023-05-02 [1] CRAN (R 4.3.1) vroom 1.6.3 2023-04-28 [1] CRAN (R 4.3.1) withr 2.5.0 2022-03-03 [1] CRAN (R 4.3.1) xfun 0.40 2023-08-09 [1] CRAN (R 4.3.1) xml2 1.3.5 2023-07-06 [1] CRAN (R 4.3.1) xtable 1.8-4 2019-04-21 [1] CRAN (R 4.3.1) yaml 2.3.7 2023-01-23 [1] CRAN (R 4.3.1) zoo 1.8-12 2023-04-13 [1] CRAN (R 4.3.1) [1] /usr/local/lib/R/site-library [2] /usr/lib/R/site-library [3] /usr/lib/R/library image

Thanks for the session info, it's good to see that packages are up to date and you're using Linux. Btw, instead of inserting pictures, you can copy-paste the text in code blocks by using triple backticks.

Best, Denes

Dear Denes,

Thanks for your patient and comprehensive answer. Your suggestion of using "triple backticks" was particularly helpful to me.

Thank you once again.

Best regards, Young