search

carmonalab / ProjecTILs

Interpretation of cell states using reference single-cell maps
GNU General Public License v3.0
252 stars 29 forks source link

ProjecTILs.classifier errors with big data #72

Open NoemieL opened 10 months ago

NoemieL commented 10 months ago

Hello, Thank you for this excellent software. I am trying to compare ProjecTILs annotation with Azimuth. I have a large dataset from bone marrow aspirations and would like to annotate all the immune cells present. I used SCTransform to prepare the data. When I try to annotate my full dataset for T cells with ProjecTIL references, I got the following error only with CD8 T cell references, but not with CD4 T cells or MoMac references:

> CD8T_human_ref <- load.reference.map("/storage/ProjecTIL/CD8T_human_ref_v1.rds")

> CD4T_human_ref <- load.reference.map("/storage/ProjecTIL/CD4T_human_ref_v2.rds")

> MoMac_human_ref<- load.reference.map("/storage/ProjecTIL/MoMac_human_v1.rds")

> DC_human_ref <- load.reference.map("/storage/ProjecTIL/DC_human_ref_v1.rds")

> merged_seurat.SCT2
An object of class Seurat 
72983 features across 86610 samples within 5 assays 
Active assay: SCT (23816 features, 3000 variable features)
 4 other assays present: RNA, refAssay, prediction.score.celltype.l2, prediction.score.celltype.l1
 4 dimensional reductions calculated: pca, umap, integrated_dr, ref.umap

> merged_seurat.SCT2 <- ProjecTILs.classifier(merged_seurat.SCT2, CD8T_human_ref2, ncores = 12, split.by = "patients",)

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 1. Consider reviewing signatures or model layout...

### Detected a total of 4710 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "4710 out of 4710 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 3. Consider reviewing signatures or model layout...

### Detected a total of 4288 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "4288 out of 4288 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 5086 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "5086 out of 5086 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 6313 non-pure cells for selected signatures - 99.92% cells marked for removal (active.ident)
[1] "6313 out of 6318 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
Alignment failed due to: Error in irlba(A = t(x = object), nv = npcs, ...): max(nu, nv) must be strictly less than min(nrow(A), ncol(A))

Warning: alignment of query dataset failed - Trying direct projection...
[1] "DIRECTLY projecting query onto Reference PCA space"
[1] "DIRECTLY projecting query onto Reference UMAP space"
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GPR15, H1-4, WARS1, CARS1, H2AZ1, H1-10, H1-3, H1-2, POLR1F, H2AC6, H4C3, MIDEAS, H2AJ, H4C8, H2AC11
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 2149 non-pure cells for selected signatures - 98.53% cells marked for removal (active.ident)
[1] "2149 out of 2181 ( 99% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
Warning in irlba(A = t(x = object), nv = npcs, ...) :
  You're computing too large a percentage of total singular values, use a standard svd instead.
Warning in irlba(A = t(x = object), nv = npcs, ...) :
  did not converge--results might be invalid!; try increasing work or maxit
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=18s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=07s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GPR15, H1-4, WARS1, CARS1, H2AZ1, H1-10, H1-3, H1-2, POLR1F, H2AC6, H4C3, MIDEAS, H2AJ, H4C8, H2AC11
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 8754 non-pure cells for selected signatures - 99.85% cells marked for removal (active.ident)
[1] "8754 out of 8767 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
Alignment failed due to: Error in irlba(A = t(x = object), nv = npcs, ...): max(nu, nv) must be strictly less than min(nrow(A), ncol(A))

Warning: alignment of query dataset failed - Trying direct projection...
[1] "DIRECTLY projecting query onto Reference PCA space"
[1] "DIRECTLY projecting query onto Reference UMAP space"
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GPR15, H1-4, WARS1, CARS1, H2AZ1, H1-10, H1-3, H1-2, POLR1F, H2AC6, H4C3, MIDEAS, H2AJ, H4C8, H2AC11
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 2659 non-pure cells for selected signatures - 80.19% cells marked for removal (active.ident)
[1] "2659 out of 3316 ( 80% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=20s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=06s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GPR15, H1-4, WARS1, CARS1, H2AZ1, H1-10, H1-3, H1-2, POLR1F, H2AC6, H4C3, MIDEAS, H2AJ, H4C8, H2AC11
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 3598 non-pure cells for selected signatures - 89.88% cells marked for removal (active.ident)
[1] "3598 out of 4003 ( 90% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=15s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=06s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GPR15, H1-4, WARS1, CARS1, H2AZ1, H1-10, H1-3, H1-2, POLR1F, H2AC6, H4C3, MIDEAS, H2AJ, H4C8, H2AC11
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 2858 non-pure cells for selected signatures - 86.55% cells marked for removal (active.ident)
[1] "2858 out of 3302 ( 87% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=15s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=08s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GPR15, H1-4, WARS1, CARS1, H2AZ1, H1-10, H1-3, H1-2, POLR1F, H2AC6, H4C3, MIDEAS, H2AJ, H4C8, H2AC11
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...
  |===============================================================================================================================================| 100%

Error: BiocParallel errors
  1 remote errors, element index: 2
  0 unevaluated and other errors
  first remote error: BiocParallel errors
  1 remote errors, element index: 1
  0 unevaluated and other errors
  first remote error: dim(X) must have a positive length
In addition: Warning messages:
1: In parallel::mccollect(wait = TRUE) :
  2 parallel jobs did not deliver results
2: stop worker failed:
  wrong args for environment subassignment

> sessionInfo()
R version 4.1.3 (2022-03-10)
Platform: x86_64-pc-linux-gnu (64-bit)
Running under: Ubuntu 20.04.4 LTS

Matrix products: default
BLAS:   /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3
LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/liblapack.so.3

locale:
 [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C               LC_TIME=en_US.UTF-8        LC_COLLATE=en_US.UTF-8     LC_MONETARY=en_US.UTF-8   
 [6] LC_MESSAGES=en_US.UTF-8    LC_PAPER=en_US.UTF-8       LC_NAME=C                  LC_ADDRESS=C               LC_TELEPHONE=C            
[11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] ProjecTILs_3.3.0    DoubletFinder_2.0.3 dplyr_1.1.4         ggplot2_3.4.4       SeuratObject_4.1.4  Seurat_4.4.0       

loaded via a namespace (and not attached):
  [1] Rtsne_0.17             colorspace_2.1-0       deldir_2.0-2           ellipsis_0.3.2         ggridges_0.5.5         STACAS_2.2.0          
  [7] BiocNeighbors_1.12.0   rstudioapi_0.15.0      spatstat.data_3.0-4    farver_2.1.1           leiden_0.4.3.1         listenv_0.9.0         
 [13] remotes_2.4.2.1        ggrepel_0.9.5          RSpectra_0.16-1        scGate_1.0.1           fansi_1.0.6            R.methodsS3_1.8.2     
 [19] codetools_0.2-18       splines_4.1.3          polyclip_1.10-6        jsonlite_1.8.8         umap_0.2.10.0          ica_1.0-3             
 [25] cluster_2.1.4          R.oo_1.25.0            png_0.1-8              pheatmap_1.0.12        uwot_0.1.16            shiny_1.8.0           
 [31] sctransform_0.4.1      spatstat.sparse_3.0-3  compiler_4.1.3         httr_1.4.7             Matrix_1.6-5           fastmap_1.1.1         
 [37] lazyeval_0.2.2         cli_3.6.2              later_1.3.2            htmltools_0.5.7        tools_4.1.3            igraph_1.6.0          
 [43] gtable_0.3.4           glue_1.7.0             RANN_2.6.1             reshape2_1.4.4         Rcpp_1.0.12            scattermore_1.2       
 [49] vctrs_0.6.5            spatstat.explore_3.2-5 nlme_3.1-159           progressr_0.14.0       lmtest_0.9-40          spatstat.random_3.2-2 
 [55] stringr_1.5.1          globals_0.16.2         mime_0.12              miniUI_0.1.1.1         lifecycle_1.0.4        irlba_2.3.5.1         
 [61] goftest_1.2-3          future_1.33.1          MASS_7.3-58.1          zoo_1.8-12             scales_1.3.0           promises_1.2.1        
 [67] spatstat.utils_3.0-4   parallel_4.1.3         RColorBrewer_1.1-3     reticulate_1.34.0      pbapply_1.7-2          gridExtra_2.3         
 [73] stringi_1.8.3          S4Vectors_0.32.4       BiocGenerics_0.40.0    BiocParallel_1.28.3    rlang_1.1.3            pkgconfig_2.0.3       
 [79] matrixStats_1.1.0      pracma_2.4.4           lattice_0.22-5         ROCR_1.0-11            purrr_1.0.2            tensor_1.5            
 [85] labeling_0.4.3         patchwork_1.2.0        htmlwidgets_1.6.4      cowplot_1.1.2          tidyselect_1.2.0       parallelly_1.36.0     
 [91] RcppAnnoy_0.0.21       plyr_1.8.9             magrittr_2.0.3         R6_2.5.1               generics_0.1.3         pillar_1.9.0          
 [97] withr_3.0.0            fitdistrplus_1.1-11    survival_3.4-0         abind_1.4-5            sp_2.1-2               tibble_3.2.1          
[103] future.apply_1.11.1    KernSmooth_2.23-20     utf8_1.2.4             spatstat.geom_3.2-7    plotly_4.10.4          grid_4.1.3            
[109] data.table_1.14.10     digest_0.6.34          xtable_1.8-4           tidyr_1.3.0            httpuv_1.6.13          R.utils_2.12.3        
[115] openssl_2.1.1          stats4_4.1.3           munsell_0.5.0          viridisLite_0.4.2      askpass_1.2.0

I have no problem when I perform a subset of my data to keep only the T cells based on azimuth annotation. I can't figure out how to solve the problem in the whole data set. Could you please help me?

Thanks Noémie

> merged_seurat_T.SCT<- subset(merged_seurat.SCT2, subset =  bm.ref.l2.summary %in% c("CD4 T cells","CD8 T cells","MAIT","T Proliferating"))

> merged_seurat_T.SCT

An object of class Seurat 
67764 features across 37641 samples within 5 assays 
Active assay: SCT (18597 features, 3000 variable features)
 4 other assays present: RNA, refAssay, prediction.score.celltype.l2, prediction.score.celltype.l1
 4 dimensional reductions calculated: pca, umap, integrated_dr, ref.umap

> merged_seurat_T.SCT <- ProjecTILs.classifier(merged_seurat_T.SCT, CD8T_human_ref,ncores = 12, split.by = "patients")

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 1104 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "1104 out of 1104 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 1. Consider reviewing signatures or model layout...

### Detected a total of 2977 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "2977 out of 2977 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 1733 non-pure cells for selected signatures - 94.60% cells marked for removal (active.ident)
[1] "1733 out of 1832 ( 95% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
Warning in irlba(A = t(x = object), nv = npcs, ...) :
  You're computing too large a percentage of total singular values, use a standard svd instead.
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=26s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=07s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 971 non-pure cells for selected signatures - 94.18% cells marked for removal (active.ident)
[1] "971 out of 1031 ( 94% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
Warning in irlba(A = t(x = object), nv = npcs, ...) :
  You're computing too large a percentage of total singular values, use a standard svd instead.
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=37s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=03s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 1908 non-pure cells for selected signatures - 89.28% cells marked for removal (active.ident)
[1] "1908 out of 2137 ( 89% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=20s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=05s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 678 non-pure cells for selected signatures - 57.26% cells marked for removal (active.ident)
[1] "678 out of 1184 ( 57% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=28s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=10s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 544 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "544 out of 544 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 832 non-pure cells for selected signatures - 54.70% cells marked for removal (active.ident)
[1] "832 out of 1521 ( 55% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=23s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=07s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 495 non-pure cells for selected signatures - 29.87% cells marked for removal (active.ident)
[1] "495 out of 1657 ( 30% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=26s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=10s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 1150 non-pure cells for selected signatures - 53.09% cells marked for removal (active.ident)
[1] "1150 out of 2166 ( 53% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=16s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=14s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 4601 non-pure cells for selected signatures - 94.69% cells marked for removal (active.ident)
[1] "4601 out of 4859 ( 95% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=16s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=14s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 3317 non-pure cells for selected signatures - 98.19% cells marked for removal (active.ident)
[1] "3317 out of 3378 ( 98% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
Warning in irlba(A = t(x = object), nv = npcs, ...) :
  You're computing too large a percentage of total singular values, use a standard svd instead.
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=14s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=06s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 2242 non-pure cells for selected signatures - 88.69% cells marked for removal (active.ident)
[1] "2242 out of 2528 ( 89% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=09s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=03s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 2549 non-pure cells for selected signatures - 58.46% cells marked for removal (active.ident)
[1] "2549 out of 4360 ( 58% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=23s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=23s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
  |                                                                                                                                               |   0%[1] "Using assay SCT for query"
Pre-filtering cells with scGate...

### Detected a total of 2722 non-pure cells for selected signatures - 42.78% cells marked for removal (active.ident)
[1] "2722 out of 6363 ( 43% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=08s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=12s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GNG4, PDLIM4, ZBED2, H1-4, GPR15, CCL18, H1-2, H4C6, H1-10, CARS1, H2AZ1, RYR2, H2AC11, H1-3, WARS1, H4C3, BMERB1, MIDEAS, H2AC6, SCUBE1, H2AJ
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

> table(merged_seurat_T.SCT$functional.cluster, useNA = "ifany")

       CD8.CM        CD8.EM      CD8.MAIT CD8.NaiveLike     CD8.TEMRA       CD8.TEX          <NA> 
         3537          1493             6          2220          2403           159         27823
mass-a commented 10 months ago

Hello Noemie,

it seems that one of the samples is failing the pre-filtering with scGate (i.e. the detection of CD8 T cells before projection into the reference). Perhaps you can try to identify which sample is causing the error? One way to do this is to split the dataset by sample and projecting them one by one. If there is anything special about that sample, i.e. very few cells, we can narrow down the source of the error.

Best -m

NoemieL commented 10 months ago

Hello Massimo,

Thanks for your quick reply. In the meantime, I've tried a few other things and if I set DefaultAssay(merged_seurat.SCT2)="RNA" instead of integrated, it works. Is it correct to do this?

> DefaultAssay(merged_seurat.SCT2)="integrated"
> merged_seurat.SCT2 <- ProjecTILs.classifier(merged_seurat.SCT2v, CD8T_human_ref,ncores = 12, split.by = "patients")
  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 1. Consider reviewing signatures or model layout...

### Detected a total of 2181 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "2181 out of 2181 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 3316 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "3316 out of 3316 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 4003 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "4003 out of 4003 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 1. Consider reviewing signatures or model layout...

### Detected a total of 4710 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "4710 out of 4710 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 3302 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "3302 out of 3302 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 1. Consider reviewing signatures or model layout...

### Detected a total of 2233 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "2233 out of 2233 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 1. Consider reviewing signatures or model layout...

### Detected a total of 4288 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "4288 out of 4288 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay integrated for query"
Pre-filtering cells with scGate...
  |===============================================================================================================================================| 100%

Error: BiocParallel errors
  1 remote errors, element index: 3
  0 unevaluated and other errors
  first remote error: BiocParallel errors
  1 remote errors, element index: 1
  0 unevaluated and other errors
  first remote error: dim(X) must have a positive length
In addition: Warning message:
stop worker failed:
  wrong args for environment subassignment 
> DefaultAssay(merged_seurat.SCT2)="RNA"
> merged_seurat.SCT2 <- ProjecTILs.classifier(merged_seurat.SCT2, CD8T_human_ref,ncores = 12, split.by = "patients")
  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 3. Consider reviewing signatures or model layout...

### Detected a total of 2181 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "2181 out of 2181 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 1. Consider reviewing signatures or model layout...

### Detected a total of 4710 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "4710 out of 4710 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 3. Consider reviewing signatures or model layout...

### Detected a total of 4288 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "4288 out of 4288 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 5086 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "5086 out of 5086 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 3. Consider reviewing signatures or model layout...

### Detected a total of 6318 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "6318 out of 6318 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 8751 non-pure cells for selected signatures - 99.82% cells marked for removal (active.ident)
[1] "8751 out of 8767 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
Alignment failed due to: Error in irlba(A = t(x = object), nv = npcs, ...): max(nu, nv) must be strictly less than min(nrow(A), ncol(A))

Warning: alignment of query dataset failed - Trying direct projection...
[1] "DIRECTLY projecting query onto Reference PCA space"
[1] "DIRECTLY projecting query onto Reference UMAP space"
Warning: Not all features provided are in this Assay object, removing the following feature(s): CXCL13, GPR15, H1-4, WARS1, CARS1, H2AZ1, H1-10, H1-3, H1-2, POLR1F, H2AC6, H4C3, MIDEAS, H2AJ, H4C8, H2AC11
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 3519 non-pure cells for selected signatures - 87.91% cells marked for removal (active.ident)
[1] "3519 out of 4003 ( 88% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=12s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=06s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 2691 non-pure cells for selected signatures - 81.15% cells marked for removal (active.ident)
[1] "2691 out of 3316 ( 81% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=15s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=08s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 2788 non-pure cells for selected signatures - 84.43% cells marked for removal (active.ident)
[1] "2788 out of 3302 ( 84% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=19s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=06s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 2. Consider reviewing signatures or model layout...

### Detected a total of 2233 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "2233 out of 2233 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 7014 non-pure cells for selected signatures - 97.28% cells marked for removal (active.ident)
[1] "7014 out of 7210 ( 97% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=09s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=06s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 4449 non-pure cells for selected signatures - 98.63% cells marked for removal (active.ident)
[1] "4449 out of 4511 ( 99% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=17s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=04s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...
Warning, all cells were removed at level 3. Consider reviewing signatures or model layout...

### Detected a total of 8580 non-pure cells for selected signatures - 100.00% cells marked for removal (active.ident)
[1] "8580 out of 8580 ( 100% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Warning! Skipping query - all cells were removed by cell filter
  |===============================================================================================================================================| 100%

  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 6513 non-pure cells for selected signatures - 80.43% cells marked for removal (active.ident)
[1] "6513 out of 8098 ( 80% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=14s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=09s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
  |                                                                                                                                               |   0%[1] "Using assay RNA for query"
Pre-filtering cells with scGate...

### Detected a total of 11532 non-pure cells for selected signatures - 82.33% cells marked for removal (active.ident)
[1] "11532 out of 14007 ( 82% ) non-pure cells removed. Use filter.cells=FALSE to avoid pre-filtering"
Performing log-normalization
0%   10   20   30   40   50   60   70   80   90   100%
[----|----|----|----|----|----|----|----|----|----|
**************************************************|
[1] "Aligning query to reference map for batch-correction..."
Preparing PCA embeddings for objects...
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=08s  
  |++++++++++++++++++++++++++++++++++++++++++++++++++| 100% elapsed=09s  

Projecting corrected query onto Reference PCA space

Projecting corrected query onto Reference UMAP space
  |===============================================================================================================================================| 100%

Creating slots functional.cluster and functional.cluster.conf in query object
> table(merged_seurat.SCT2$functional.cluster, useNA = "ifany")

       CD8.CM        CD8.EM      CD8.MAIT CD8.NaiveLike     CD8.TEMRA       CD8.TEX      CD8.TPEX          <NA> 
          405          1011            19          2722          1668           125             7         80653
mass-a commented 10 months ago

Hello Noemie,

I would definitely recommend NOT to use the integrated assay for your query data. ProjecTILs is already taking care of the batch effect correction by projecting each sample separetely, so I'd recommend using the uncorrected RNA assay for the query (or alternatively SCT if you believe that is a better normalization). Besides, the 'integrated' assay by default will only contain the variable genes for the query; that may also limit the ability of the method to align the query and the reference.

Best -massimo

NoemieL commented 10 months ago

Hello Massimo,

I see thank you for this clarification! Should I also used the RNA assay for the reference, in your tutorial Exhausted CD8 T cells are associated with ICB responsiveness in breast cancer they are set up at integrated DefaultAssay(ref.cd4) <- "integrated". Thanks for your help.

Best Noemie