search

biomodhub / biomod2

BIOMOD is a computer platform for ensemble forecasting of species distributions, enabling the treatment of a range of methodological uncertainties in models and the examination of species-environment relationships.
77 stars 21 forks source link

Ensemble models scores are lower than single models scores. #432

Closed LorenzoBernicchi closed 3 months ago

LorenzoBernicchi commented 3 months ago

Hello everyone, I am modeling the distribution of the red deer over its global distribution. However, when I build the ensemble model the resulting scores (I selected the ROC and TSS) are lower compared to the scores of some single algorithm models. Can someone explain to me why this is happening? Could it be related to some modeling error or to my data?

Thanks in advance, herefater I provide all the functions and related output I used.

Selected_algos <- c("CTA", "FDA", "GAM", "GBM", "GLM", "MAXENT", "MAXNET")

##Defining the options for the MAXENT algorithm
user.MAXENT <- list('_allData_allRun' = list(
  path_to_maxent.jar = "."
))

##Defining the user options 
user.val <- list(MAXENT.binary.MAXENT.MAXENT = user.MAXENT)
myOptions <- bm_ModelingOptions(data.type = 'binary',
                                models = Selected_algos,
                                strategy = 'user.defined',
                                user.val = user.val,
                                user.base = 'bigboss')

####STARTING WITH THE FINAL MODELING OF BIOMOD2
BIOMOD_data <- BIOMOD_FormatingData(
  resp.name = "cervus_global_Alpi",
  resp.var = cervus_points[,c("pres")],
  expl.var = Bioclim_cervus,
  PA.nb.rep = 1, 
  PA.nb.absences = 20000,
  PA.strategy = 'random', 
  na.rm = T, filter.raster = T, 
)

show(BIOMOD_data)
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= BIOMOD.formated.data -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

dir.name =  .

sp.name =  cervus.global.Alpi

     1952 presences,  0 true absences and  20000 undefined points in dataset

     6 explanatory variables

     bio_7             bio_10          bio_11           bio_12           bio_14      
 Min.   :  6.536   Min.   :  0.0   Min.   :  23.0   Min.   : 2.683   Min.   : 267.6  
 1st Qu.: 24.883   1st Qu.:138.0   1st Qu.:  99.0   1st Qu.: 7.917   1st Qu.: 674.4  
 Median : 31.505   Median :194.0   Median : 118.0   Median : 8.650   Median : 829.5  
 Mean   : 33.509   Mean   :176.9   Mean   : 153.3   Mean   : 9.039   Mean   : 844.7  
 3rd Qu.: 36.559   3rd Qu.:222.0   3rd Qu.: 176.0   3rd Qu.: 9.967   3rd Qu.:1010.1  
 Max.   :119.208   Max.   :659.0   Max.   :1148.0   Max.   :15.883   Max.   :1397.3  
     bio_18       
 Min.   :-10.083  
 1st Qu.:  8.833  
 Median : 13.300  
 Mean   : 12.440  
 3rd Qu.: 16.600  
 Max.   : 24.033  

 1 Pseudo Absences dataset available ( PA1 ) with  20000 (PA1) pseudo absences

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
show(Bioclim_cervus)
class       : SpatRaster 
dimensions  : 4958, 9451, 6  (nrow, ncol, nlyr)
resolution  : 0.008333333, 0.008333333  (x, y)
extent      : -10.59167, 68.16667, 29.89167, 71.20833  (xmin, xmax, ymin, ymax)
coord. ref. : lon/lat WGS 84 (EPSG:4326) 
source      : spat_3458639c2b0e_13400.tif 
names       :      bio_7, bio_10, bio_11,   bio_12,   bio_14,    bio_18 
min values  :   4.120157,      0,     13,  1.00000,    0.000, -16.91667 
max values  : 120.114082,    791,   1169, 16.10833, 1424.456,  24.41667 
cervus_single_models_global <- BIOMOD_Modeling(
  bm.format = BIOMOD_data,
  modeling.id = "Single.models",
  models = Selected_algos,
  CV.strategy = "random",
  CV.nb.rep = 20,
  CV.perc = 0.7,
  CV.do.full.models = F,
  bm.options = myOptions,
  metric.eval = c("ROC", "TSS"),
  var.import = 1,
  nb.cpu = 4,
  do.progress = T
)

show(cervus_single_models_global)

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= BIOMOD.models.out -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

Modeling folder : .

Species modeled : cervus.global.Alpi

Modeling id : Single.models

Considered variables : bio_7 bio_10 bio_11 bio_12 bio_14 bio_18

Computed Models :  cervus.global.Alpi_PA1_RUN1_CTA cervus.global.Alpi_PA1_RUN1_FDA 
cervus.global.Alpi_PA1_RUN1_GAM cervus.global.Alpi_PA1_RUN1_GBM 
cervus.global.Alpi_PA1_RUN1_GLM cervus.global.Alpi_PA1_RUN1_MAXENT 
cervus.global.Alpi_PA1_RUN1_MAXNET cervus.global.Alpi_PA1_RUN2_CTA 
cervus.global.Alpi_PA1_RUN2_FDA cervus.global.Alpi_PA1_RUN2_GAM 
cervus.global.Alpi_PA1_RUN2_GBM cervus.global.Alpi_PA1_RUN2_GLM 
cervus.global.Alpi_PA1_RUN2_MAXENT cervus.global.Alpi_PA1_RUN2_MAXNET 
cervus.global.Alpi_PA1_RUN3_CTA cervus.global.Alpi_PA1_RUN3_FDA 
cervus.global.Alpi_PA1_RUN3_GAM cervus.global.Alpi_PA1_RUN3_GBM 
cervus.global.Alpi_PA1_RUN3_GLM cervus.global.Alpi_PA1_RUN3_MAXENT 
cervus.global.Alpi_PA1_RUN3_MAXNET cervus.global.Alpi_PA1_RUN4_CTA 
cervus.global.Alpi_PA1_RUN4_FDA cervus.global.Alpi_PA1_RUN4_GAM 
cervus.global.Alpi_PA1_RUN4_GBM cervus.global.Alpi_PA1_RUN4_GLM 
cervus.global.Alpi_PA1_RUN4_MAXENT cervus.global.Alpi_PA1_RUN4_MAXNET 
cervus.global.Alpi_PA1_RUN5_CTA cervus.global.Alpi_PA1_RUN5_FDA 
cervus.global.Alpi_PA1_RUN5_GAM cervus.global.Alpi_PA1_RUN5_GBM 
cervus.global.Alpi_PA1_RUN5_GLM cervus.global.Alpi_PA1_RUN5_MAXENT 
cervus.global.Alpi_PA1_RUN5_MAXNET cervus.global.Alpi_PA1_RUN6_CTA 
cervus.global.Alpi_PA1_RUN6_FDA cervus.global.Alpi_PA1_RUN6_GAM 
cervus.global.Alpi_PA1_RUN6_GBM cervus.global.Alpi_PA1_RUN6_GLM 
cervus.global.Alpi_PA1_RUN6_MAXENT cervus.global.Alpi_PA1_RUN6_MAXNET 
cervus.global.Alpi_PA1_RUN7_CTA cervus.global.Alpi_PA1_RUN7_FDA 
cervus.global.Alpi_PA1_RUN7_GAM cervus.global.Alpi_PA1_RUN7_GBM 
cervus.global.Alpi_PA1_RUN7_GLM cervus.global.Alpi_PA1_RUN7_MAXENT 
cervus.global.Alpi_PA1_RUN7_MAXNET cervus.global.Alpi_PA1_RUN8_CTA 
cervus.global.Alpi_PA1_RUN8_FDA cervus.global.Alpi_PA1_RUN8_GAM 
cervus.global.Alpi_PA1_RUN8_GBM cervus.global.Alpi_PA1_RUN8_GLM 
cervus.global.Alpi_PA1_RUN8_MAXENT cervus.global.Alpi_PA1_RUN8_MAXNET 
cervus.global.Alpi_PA1_RUN9_CTA cervus.global.Alpi_PA1_RUN9_FDA 
cervus.global.Alpi_PA1_RUN9_GAM cervus.global.Alpi_PA1_RUN9_GBM 
cervus.global.Alpi_PA1_RUN9_GLM cervus.global.Alpi_PA1_RUN9_MAXENT 
cervus.global.Alpi_PA1_RUN9_MAXNET cervus.global.Alpi_PA1_RUN10_CTA 
cervus.global.Alpi_PA1_RUN10_FDA cervus.global.Alpi_PA1_RUN10_GAM 
cervus.global.Alpi_PA1_RUN10_GBM cervus.global.Alpi_PA1_RUN10_GLM 
cervus.global.Alpi_PA1_RUN10_MAXENT cervus.global.Alpi_PA1_RUN10_MAXNET 
cervus.global.Alpi_PA1_RUN11_CTA cervus.global.Alpi_PA1_RUN11_FDA 
cervus.global.Alpi_PA1_RUN11_GAM cervus.global.Alpi_PA1_RUN11_GBM 
cervus.global.Alpi_PA1_RUN11_GLM cervus.global.Alpi_PA1_RUN11_MAXENT 
cervus.global.Alpi_PA1_RUN11_MAXNET cervus.global.Alpi_PA1_RUN12_CTA 
cervus.global.Alpi_PA1_RUN12_FDA cervus.global.Alpi_PA1_RUN12_GAM 
cervus.global.Alpi_PA1_RUN12_GBM cervus.global.Alpi_PA1_RUN12_GLM 
cervus.global.Alpi_PA1_RUN12_MAXENT cervus.global.Alpi_PA1_RUN12_MAXNET 
cervus.global.Alpi_PA1_RUN13_CTA cervus.global.Alpi_PA1_RUN13_FDA 
cervus.global.Alpi_PA1_RUN13_GAM cervus.global.Alpi_PA1_RUN13_GBM 
cervus.global.Alpi_PA1_RUN13_GLM cervus.global.Alpi_PA1_RUN13_MAXENT 
cervus.global.Alpi_PA1_RUN13_MAXNET cervus.global.Alpi_PA1_RUN14_CTA 
cervus.global.Alpi_PA1_RUN14_FDA cervus.global.Alpi_PA1_RUN14_GAM 
cervus.global.Alpi_PA1_RUN14_GBM cervus.global.Alpi_PA1_RUN14_GLM 
cervus.global.Alpi_PA1_RUN14_MAXENT cervus.global.Alpi_PA1_RUN14_MAXNET 
cervus.global.Alpi_PA1_RUN15_CTA cervus.global.Alpi_PA1_RUN15_FDA 
cervus.global.Alpi_PA1_RUN15_GAM cervus.global.Alpi_PA1_RUN15_GBM 
cervus.global.Alpi_PA1_RUN15_GLM cervus.global.Alpi_PA1_RUN15_MAXENT 
cervus.global.Alpi_PA1_RUN15_MAXNET cervus.global.Alpi_PA1_RUN16_CTA 
cervus.global.Alpi_PA1_RUN16_FDA cervus.global.Alpi_PA1_RUN16_GAM 
cervus.global.Alpi_PA1_RUN16_GBM cervus.global.Alpi_PA1_RUN16_GLM 
cervus.global.Alpi_PA1_RUN16_MAXENT cervus.global.Alpi_PA1_RUN16_MAXNET 
cervus.global.Alpi_PA1_RUN17_CTA cervus.global.Alpi_PA1_RUN17_FDA 
cervus.global.Alpi_PA1_RUN17_GAM cervus.global.Alpi_PA1_RUN17_GBM 
cervus.global.Alpi_PA1_RUN17_GLM cervus.global.Alpi_PA1_RUN17_MAXENT 
cervus.global.Alpi_PA1_RUN17_MAXNET cervus.global.Alpi_PA1_RUN18_CTA 
cervus.global.Alpi_PA1_RUN18_FDA cervus.global.Alpi_PA1_RUN18_GAM 
cervus.global.Alpi_PA1_RUN18_GBM cervus.global.Alpi_PA1_RUN18_GLM 
cervus.global.Alpi_PA1_RUN18_MAXENT cervus.global.Alpi_PA1_RUN18_MAXNET 
cervus.global.Alpi_PA1_RUN19_CTA cervus.global.Alpi_PA1_RUN19_FDA 
cervus.global.Alpi_PA1_RUN19_GAM cervus.global.Alpi_PA1_RUN19_GBM 
cervus.global.Alpi_PA1_RUN19_GLM cervus.global.Alpi_PA1_RUN19_MAXENT 
cervus.global.Alpi_PA1_RUN19_MAXNET cervus.global.Alpi_PA1_RUN20_CTA 
cervus.global.Alpi_PA1_RUN20_FDA cervus.global.Alpi_PA1_RUN20_GAM 
cervus.global.Alpi_PA1_RUN20_GBM cervus.global.Alpi_PA1_RUN20_GLM 
cervus.global.Alpi_PA1_RUN20_MAXENT cervus.global.Alpi_PA1_RUN20_MAXNET

Failed Models :  none

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

scores <- get_evaluations(cervus_single_models_global)

<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns="http://www.w3.org/TR/REC-html40">

  | full.name | PA | run | algo | metric.eval | cutoff | sensitivity | specificity | calibration | validation | evaluation -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- 1 | cervus.global.Alpi_PA1_RUN1_CTA | PA1 | RUN1 | CTA | ROC | 408,5 | 92,753 | 60,857 | 0,8 | 0,805 | NA 2 | cervus.global.Alpi_PA1_RUN1_CTA | PA1 | RUN1 | CTA | TSS | 411 | 92,753 | 60,857 | 0,536 | 0,549 | NA 3 | cervus.global.Alpi_PA1_RUN1_FDA | PA1 | RUN1 | FDA | ROC | 331,5 | 92,753 | 58,929 | 0,814 | 0,824 | NA 4 | cervus.global.Alpi_PA1_RUN1_FDA | PA1 | RUN1 | FDA | TSS | 327 | 93,192 | 57,836 | 0,51 | 0,533 | NA 5 | cervus.global.Alpi_PA1_RUN1_GAM | PA1 | RUN1 | GAM | ROC | 390,5 | 91,142 | 60,707 | 0,814 | 0,824 | NA 6 | cervus.global.Alpi_PA1_RUN1_GAM | PA1 | RUN1 | GAM | TSS | 383 | 91,801 | 59,907 | 0,518 | 0,535 | NA 7 | cervus.global.Alpi_PA1_RUN1_GBM | PA1 | RUN1 | GBM | ROC | 461,5 | 92,313 | 61,814 | 0,826 | 0,827 | NA 8 | cervus.global.Alpi_PA1_RUN1_GBM | PA1 | RUN1 | GBM | TSS | 461 | 92,387 | 61,721 | 0,541 | 0,54 | NA 9 | cervus.global.Alpi_PA1_RUN1_GLM | PA1 | RUN1 | GLM | ROC | 442,5 | 91,215 | 61,564 | 0,817 | 0,827 | NA 10 | cervus.global.Alpi_PA1_RUN1_GLM | PA1 | RUN1 | GLM | TSS | 446 | 90,922 | 61,75 | 0,527 | 0,538 | NA 11 | cervus.global.Alpi_PA1_RUN1_MAXENT | PA1 | RUN1 | MAXENT | ROC | 323,5 | 90,776 | 64,536 | 0,837 | 0,834 | NA 12 | cervus.global.Alpi_PA1_RUN1_MAXENT | PA1 | RUN1 | MAXENT | TSS | 318 | 91,069 | 63,779 | 0,55 | 0,559 | NA 13 | cervus.global.Alpi_PA1_RUN1_MAXNET | PA1 | RUN1 | MAXNET | ROC | 337,5 | 89,824 | 64,257 | 0,828 | 0,834 | NA 14 | cervus.global.Alpi_PA1_RUN1_MAXNET | PA1 | RUN1 | MAXNET | TSS | 335 | 90,117 | 63,929 | 0,541 | 0,568 | NA 15 | cervus.global.Alpi_PA1_RUN2_CTA | PA1 | RUN2 | CTA | ROC | 479 | 91,508 | 63,479 | 0,804 | 0,799 | NA 16 | cervus.global.Alpi_PA1_RUN2_CTA | PA1 | RUN2 | CTA | TSS | 480 | 91,508 | 63,479 | 0,55 | 0,538 | NA 17 | cervus.global.Alpi_PA1_RUN2_FDA | PA1 | RUN2 | FDA | ROC | 348,5 | 89,751 | 62,843 | 0,819 | 0,815 | NA 18 | cervus.global.Alpi_PA1_RUN2_FDA | PA1 | RUN2 | FDA | TSS | 347 | 89,971 | 62,379 | 0,524 | 0,504 | NA 19 | cervus.global.Alpi_PA1_RUN2_GAM | PA1 | RUN2 | GAM | ROC | 390,5 | 91,215 | 61,657 | 0,819 | 0,814 | NA 20 | cervus.global.Alpi_PA1_RUN2_GAM | PA1 | RUN2 | GAM | TSS | 394 | 90,922 | 61,936 | 0,528 | 0,508 | NA 21 | cervus.global.Alpi_PA1_RUN2_GBM | PA1 | RUN2 | GBM | ROC | 462,5 | 91,508 | 64,064 | 0,832 | 0,817 | NA 22 | cervus.global.Alpi_PA1_RUN2_GBM | PA1 | RUN2 | GBM | TSS | 464 | 91,288 | 64,221 | 0,555 | 0,526 | NA 23 | cervus.global.Alpi_PA1_RUN2_GLM | PA1 | RUN2 | GLM | ROC | 441,5 | 90,996 | 62,4 | 0,822 | 0,815 | NA 24 | cervus.global.Alpi_PA1_RUN2_GLM | PA1 | RUN2 | GLM | TSS | 440 | 91,142 | 62,2 | 0,534 | 0,521 | NA 25 | cervus.global.Alpi_PA1_RUN2_MAXENT | PA1 | RUN2 | MAXENT | ROC | 345,5 | 87,262 | 68,843 | 0,842 | 0,821 | NA 26 | cervus.global.Alpi_PA1_RUN2_MAXENT | PA1 | RUN2 | MAXENT | TSS | 348 | 86,823 | 69,014 | 0,56 | 0,52 | NA 27 | cervus.global.Alpi_PA1_RUN2_MAXNET | PA1 | RUN2 | MAXNET | ROC | 362,5 | 87,408 | 68,079 | 0,833 | 0,82 | NA 28 | cervus.global.Alpi_PA1_RUN2_MAXNET | PA1 | RUN2 | MAXNET | TSS | 362 | 87,408 | 68 | 0,555 | 0,535 | NA 29 | cervus.global.Alpi_PA1_RUN3_CTA | PA1 | RUN3 | CTA | ROC | 415,5 | 92,826 | 60,829 | 0,801 | 0,803 | NA 30 | cervus.global.Alpi_PA1_RUN3_CTA | PA1 | RUN3 | CTA | TSS | 415 | 92,826 | 60,829 | 0,537 | 0,544 | NA 31 | cervus.global.Alpi_PA1_RUN3_FDA | PA1 | RUN3 | FDA | ROC | 334,5 | 92,24 | 59,7 | 0,815 | 0,823 | NA 32 | cervus.global.Alpi_PA1_RUN3_FDA | PA1 | RUN3 | FDA | TSS | 335 | 92,24 | 59,7 | 0,518 | 0,519 | NA 33 | cervus.global.Alpi_PA1_RUN3_GAM | PA1 | RUN3 | GAM | ROC | 391,5 | 90,996 | 60,95 | 0,815 | 0,823 | NA 34 | cervus.global.Alpi_PA1_RUN3_GAM | PA1 | RUN3 | GAM | TSS | 383 | 91,654 | 60,071 | 0,518 | 0,531 | NA 35 | cervus.global.Alpi_PA1_RUN3_GBM | PA1 | RUN3 | GBM | ROC | 477,5 | 89,824 | 64,343 | 0,829 | 0,827 | NA 36 | cervus.global.Alpi_PA1_RUN3_GBM | PA1 | RUN3 | GBM | TSS | 480 | 89,605 | 64,507 | 0,54 | 0,542 | NA 37 | cervus.global.Alpi_PA1_RUN3_GLM | PA1 | RUN3 | GLM | ROC | 448,5 | 90,264 | 62,114 | 0,817 | 0,826 | NA 38 | cervus.global.Alpi_PA1_RUN3_GLM | PA1 | RUN3 | GLM | TSS | 419 | 92,24 | 59,993 | 0,523 | 0,531 | NA 39 | cervus.global.Alpi_PA1_RUN3_MAXENT | PA1 | RUN3 | MAXENT | ROC | 338,5 | 89,019 | 66,421 | 0,84 | 0,829 | NA 40 | cervus.global.Alpi_PA1_RUN3_MAXENT | PA1 | RUN3 | MAXENT | TSS | 345 | 88,141 | 67,093 | 0,553 | 0,545 | NA 41 | cervus.global.Alpi_PA1_RUN3_MAXNET | PA1 | RUN3 | MAXNET | ROC | 363,5 | 87,628 | 67,057 | 0,83 | 0,83 | NA 42 | cervus.global.Alpi_PA1_RUN3_MAXNET | PA1 | RUN3 | MAXNET | TSS | 365 | 87,408 | 67,121 | 0,546 | 0,551 | NA 43 | cervus.global.Alpi_PA1_RUN4_CTA | PA1 | RUN4 | CTA | ROC | 424,5 | 92,313 | 61,843 | 0,808 | 0,793 | NA 44 | cervus.global.Alpi_PA1_RUN4_CTA | PA1 | RUN4 | CTA | TSS | 423 | 92,313 | 61,843 | 0,542 | 0,522 | NA 45 | cervus.global.Alpi_PA1_RUN4_FDA | PA1 | RUN4 | FDA | ROC | 330,5 | 93,558 | 58,757 | 0,819 | 0,814 | NA 46 | cervus.global.Alpi_PA1_RUN4_FDA | PA1 | RUN4 | FDA | TSS | 349 | 89,458 | 62,671 | 0,519 | 0,517 | NA 47 | cervus.global.Alpi_PA1_RUN4_GAM | PA1 | RUN4 | GAM | ROC | 381,5 | 92,094 | 60,757 | 0,819 | 0,815 | NA 48 | cervus.global.Alpi_PA1_RUN4_GAM | PA1 | RUN4 | GAM | TSS | 382 | 92,094 | 60,757 | 0,528 | 0,518 | NA 49 | cervus.global.Alpi_PA1_RUN4_GBM | PA1 | RUN4 | GBM | ROC | 456,5 | 91,435 | 63,707 | 0,832 | 0,812 | NA 50 | cervus.global.Alpi_PA1_RUN4_GBM | PA1 | RUN4 | GBM | TSS | 425 | 93,704 | 61,064 | 0,548 | 0,525 | NA 51 | cervus.global.Alpi_PA1_RUN4_GLM | PA1 | RUN4 | GLM | ROC | 429,5 | 92,094 | 61,621 | 0,824 | 0,813 | NA 52 | cervus.global.Alpi_PA1_RUN4_GLM | PA1 | RUN4 | GLM | TSS | 451 | 90,337 | 63,221 | 0,535 | 0,513 | NA 53 | cervus.global.Alpi_PA1_RUN4_MAXENT | PA1 | RUN4 | MAXENT | ROC | 287,5 | 93,558 | 62,671 | 0,842 | 0,816 | NA 54 | cervus.global.Alpi_PA1_RUN4_MAXENT | PA1 | RUN4 | MAXENT | TSS | 309 | 91,069 | 64,843 | 0,56 | 0,537 | NA 55 | cervus.global.Alpi_PA1_RUN4_MAXNET | PA1 | RUN4 | MAXNET | ROC | 368,5 | 86,164 | 68,729 | 0,833 | 0,819 | NA 56 | cervus.global.Alpi_PA1_RUN4_MAXNET | PA1 | RUN4 | MAXNET | TSS | 367 | 86,31 | 68,557 | 0,549 | 0,526 | NA 57 | cervus.global.Alpi_PA1_RUN5_CTA | PA1 | RUN5 | CTA | ROC | 419 | 93,704 | 60,55 | 0,806 | 0,794 | NA 58 | cervus.global.Alpi_PA1_RUN5_CTA | PA1 | RUN5 | CTA | TSS | 420 | 93,704 | 60,55 | 0,543 | 0,527 | NA 59 | cervus.global.Alpi_PA1_RUN5_FDA | PA1 | RUN5 | FDA | ROC | 335,5 | 93,265 | 59,471 | 0,822 | 0,807 | NA 60 | cervus.global.Alpi_PA1_RUN5_FDA | PA1 | RUN5 | FDA | TSS | 335 | 93,485 | 59,229 | 0,527 | 0,511 | NA 61 | cervus.global.Alpi_PA1_RUN5_GAM | PA1 | RUN5 | GAM | ROC | 376,5 | 92,167 | 60,9 | 0,823 | 0,807 | NA 62 | cervus.global.Alpi_PA1_RUN5_GAM | PA1 | RUN5 | GAM | TSS | 376 | 92,24 | 60,779 | 0,531 | 0,514 | NA 63 | cervus.global.Alpi_PA1_RUN5_GBM | PA1 | RUN5 | GBM | ROC | 452,5 | 93,924 | 61,843 | 0,832 | 0,814 | NA 64 | cervus.global.Alpi_PA1_RUN5_GBM | PA1 | RUN5 | GBM | TSS | 457 | 93,558 | 62,171 | 0,558 | 0,534 | NA 65 | cervus.global.Alpi_PA1_RUN5_GLM | PA1 | RUN5 | GLM | ROC | 406,5 | 93,192 | 60,4 | 0,825 | 0,809 | NA 66 | cervus.global.Alpi_PA1_RUN5_GLM | PA1 | RUN5 | GLM | TSS | 400 | 93,485 | 59,886 | 0,534 | 0,507 | NA 67 | cervus.global.Alpi_PA1_RUN5_MAXENT | PA1 | RUN5 | MAXENT | ROC | 338,5 | 91,874 | 65,407 | 0,842 | 0,818 | NA 68 | cervus.global.Alpi_PA1_RUN5_MAXENT | PA1 | RUN5 | MAXENT | TSS | 323 | 93,485 | 63,7 | 0,573 | 0,535 | NA 69 | cervus.global.Alpi_PA1_RUN5_MAXNET | PA1 | RUN5 | MAXNET | ROC | 348,5 | 89,678 | 65,921 | 0,833 | 0,82 | NA 70 | cervus.global.Alpi_PA1_RUN5_MAXNET | PA1 | RUN5 | MAXNET | TSS | 345 | 89,898 | 65,586 | 0,555 | 0,535 | NA 71 | cervus.global.Alpi_PA1_RUN6_CTA | PA1 | RUN6 | CTA | ROC | 415,5 | 93,045 | 61,064 | 0,8 | 0,806 | NA 72 | cervus.global.Alpi_PA1_RUN6_CTA | PA1 | RUN6 | CTA | TSS | 417 | 93,045 | 61,064 | 0,541 | 0,537 | NA 73 | cervus.global.Alpi_PA1_RUN6_FDA | PA1 | RUN6 | FDA | ROC | 330,5 | 92,972 | 59,064 | 0,816 | 0,822 | NA 74 | cervus.global.Alpi_PA1_RUN6_FDA | PA1 | RUN6 | FDA | TSS | 328 | 93,338 | 58,407 | 0,519 | 0,52 | NA 75 | cervus.global.Alpi_PA1_RUN6_GAM | PA1 | RUN6 | GAM | ROC | 391,5 | 91,069 | 61,407 | 0,816 | 0,822 | NA 76 | cervus.global.Alpi_PA1_RUN6_GAM | PA1 | RUN6 | GAM | TSS | 394 | 90,849 | 61,586 | 0,523 | 0,53 | NA 77 | cervus.global.Alpi_PA1_RUN6_GBM | PA1 | RUN6 | GBM | ROC | 468,5 | 91,581 | 62,779 | 0,827 | 0,824 | NA 78 | cervus.global.Alpi_PA1_RUN6_GBM | PA1 | RUN6 | GBM | TSS | 465 | 91,654 | 62,507 | 0,542 | 0,55 | NA 79 | cervus.global.Alpi_PA1_RUN6_GLM | PA1 | RUN6 | GLM | ROC | 421,5 | 92,24 | 60,514 | 0,818 | 0,824 | NA 80 | cervus.global.Alpi_PA1_RUN6_GLM | PA1 | RUN6 | GLM | TSS | 419 | 92,313 | 60,321 | 0,527 | 0,538 | NA 81 | cervus.global.Alpi_PA1_RUN6_MAXENT | PA1 | RUN6 | MAXENT | ROC | 320,5 | 92,094 | 63,714 | 0,838 | 0,83 | NA 82 | cervus.global.Alpi_PA1_RUN6_MAXENT | PA1 | RUN6 | MAXENT | TSS | 320 | 92,094 | 63,629 | 0,558 | 0,562 | NA 83 | cervus.global.Alpi_PA1_RUN6_MAXNET | PA1 | RUN6 | MAXNET | ROC | 340,5 | 90,19 | 64,207 | 0,828 | 0,831 | NA 84 | cervus.global.Alpi_PA1_RUN6_MAXNET | PA1 | RUN6 | MAXNET | TSS | 339 | 90,337 | 64,043 | 0,543 | 0,552 | NA 85 | cervus.global.Alpi_PA1_RUN7_CTA | PA1 | RUN7 | CTA | ROC | 434,5 | 92,387 | 63,05 | 0,806 | 0,792 | NA 86 | cervus.global.Alpi_PA1_RUN7_CTA | PA1 | RUN7 | CTA | TSS | 432 | 92,387 | 63,05 | 0,554 | 0,524 | NA 87 | cervus.global.Alpi_PA1_RUN7_FDA | PA1 | RUN7 | FDA | ROC | 339,5 | 91,435 | 60,429 | 0,817 | 0,818 | NA 88 | cervus.global.Alpi_PA1_RUN7_FDA | PA1 | RUN7 | FDA | TSS | 333 | 92,606 | 58,971 | 0,517 | 0,505 | NA 89 | cervus.global.Alpi_PA1_RUN7_GAM | PA1 | RUN7 | GAM | ROC | 415,5 | 88,653 | 63,643 | 0,817 | 0,819 | NA 90 | cervus.global.Alpi_PA1_RUN7_GAM | PA1 | RUN7 | GAM | TSS | 392 | 90,703 | 61,286 | 0,521 | 0,511 | NA 91 | cervus.global.Alpi_PA1_RUN7_GBM | PA1 | RUN7 | GBM | ROC | 467,5 | 89,971 | 64,643 | 0,83 | 0,82 | NA 92 | cervus.global.Alpi_PA1_RUN7_GBM | PA1 | RUN7 | GBM | TSS | 466 | 89,971 | 64,493 | 0,545 | 0,522 | NA 93 | cervus.global.Alpi_PA1_RUN7_GLM | PA1 | RUN7 | GLM | ROC | 433,5 | 91,508 | 61,686 | 0,821 | 0,819 | NA 94 | cervus.global.Alpi_PA1_RUN7_GLM | PA1 | RUN7 | GLM | TSS | 437 | 91,142 | 61,921 | 0,531 | 0,519 | NA 95 | cervus.global.Alpi_PA1_RUN7_MAXENT | PA1 | RUN7 | MAXENT | ROC | 311,5 | 90,922 | 64,764 | 0,842 | 0,822 | NA 96 | cervus.global.Alpi_PA1_RUN7_MAXENT | PA1 | RUN7 | MAXENT | TSS | 306 | 91,508 | 63,971 | 0,556 | 0,518 | NA 97 | cervus.global.Alpi_PA1_RUN7_MAXNET | PA1 | RUN7 | MAXNET | ROC | 390,5 | 84,846 | 70,207 | 0,831 | 0,824 | NA 98 | cervus.global.Alpi_PA1_RUN7_MAXNET | PA1 | RUN7 | MAXNET | TSS | 388 | 85,139 | 69,857 | 0,549 | 0,516 | NA 99 | cervus.global.Alpi_PA1_RUN8_CTA | PA1 | RUN8 | CTA | ROC | 410,5 | 92,972 | 61,607 | 0,803 | 0,798 | NA 100 | cervus.global.Alpi_PA1_RUN8_CTA | PA1 | RUN8 | CTA | TSS | 412 | 92,972 | 61,607 | 0,546 | 0,544 | NA 101 | cervus.global.Alpi_PA1_RUN8_FDA | PA1 | RUN8 | FDA | ROC | 345,5 | 90,703 | 61,457 | 0,817 | 0,816 | NA 102 | cervus.global.Alpi_PA1_RUN8_FDA | PA1 | RUN8 | FDA | TSS | 348 | 90,117 | 61,879 | 0,52 | 0,501 | NA 103 | cervus.global.Alpi_PA1_RUN8_GAM | PA1 | RUN8 | GAM | ROC | 375,5 | 93,192 | 59,907 | 0,817 | 0,817 | NA 104 | cervus.global.Alpi_PA1_RUN8_GAM | PA1 | RUN8 | GAM | TSS | 375 | 93,265 | 59,779 | 0,531 | 0,506 | NA 105 | cervus.global.Alpi_PA1_RUN8_GBM | PA1 | RUN8 | GBM | ROC | 458,5 | 92,24 | 62,721 | 0,83 | 0,82 | NA 106 | cervus.global.Alpi_PA1_RUN8_GBM | PA1 | RUN8 | GBM | TSS | 452 | 92,753 | 62,121 | 0,549 | 0,528 | NA 107 | cervus.global.Alpi_PA1_RUN8_GLM | PA1 | RUN8 | GLM | ROC | 431,5 | 92,387 | 61,2 | 0,821 | 0,818 | NA 108 | cervus.global.Alpi_PA1_RUN8_GLM | PA1 | RUN8 | GLM | TSS | 432 | 92,387 | 61,2 | 0,535 | 0,516 | NA 109 | cervus.global.Alpi_PA1_RUN8_MAXENT | PA1 | RUN8 | MAXENT | ROC | 305,5 | 91,581 | 64,364 | 0,841 | 0,821 | NA 110 | cervus.global.Alpi_PA1_RUN8_MAXENT | PA1 | RUN8 | MAXENT | TSS | 306 | 91,581 | 64,364 | 0,559 | 0,523 | NA 111 | cervus.global.Alpi_PA1_RUN8_MAXNET | PA1 | RUN8 | MAXNET | ROC | 382,5 | 86,237 | 68,986 | 0,832 | 0,824 | NA 112 | cervus.global.Alpi_PA1_RUN8_MAXNET | PA1 | RUN8 | MAXNET | TSS | 382 | 86,237 | 68,964 | 0,552 | 0,519 | NA 113 | cervus.global.Alpi_PA1_RUN9_CTA | PA1 | RUN9 | CTA | ROC | 391 | 94,143 | 59,8 | 0,8 | 0,805 | NA 114 | cervus.global.Alpi_PA1_RUN9_CTA | PA1 | RUN9 | CTA | TSS | 391 | 94,143 | 59,8 | 0,539 | 0,525 | NA 115 | cervus.global.Alpi_PA1_RUN9_FDA | PA1 | RUN9 | FDA | ROC | 338,5 | 91,581 | 60,407 | 0,817 | 0,819 | NA 116 | cervus.global.Alpi_PA1_RUN9_FDA | PA1 | RUN9 | FDA | TSS | 339 | 91,581 | 60,407 | 0,518 | 0,526 | NA 117 | cervus.global.Alpi_PA1_RUN9_GAM | PA1 | RUN9 | GAM | ROC | 394,5 | 90,264 | 61,979 | 0,817 | 0,819 | NA 118 | cervus.global.Alpi_PA1_RUN9_GAM | PA1 | RUN9 | GAM | TSS | 394 | 90,264 | 61,864 | 0,522 | 0,52 | NA 119 | cervus.global.Alpi_PA1_RUN9_GBM | PA1 | RUN9 | GBM | ROC | 436,5 | 94,29 | 60,657 | 0,827 | 0,825 | NA 120 | cervus.global.Alpi_PA1_RUN9_GBM | PA1 | RUN9 | GBM | TSS | 458 | 92,24 | 62,571 | 0,548 | 0,524 | NA 121 | cervus.global.Alpi_PA1_RUN9_GLM | PA1 | RUN9 | GLM | ROC | 452,5 | 89,458 | 63,05 | 0,82 | 0,818 | NA 122 | cervus.global.Alpi_PA1_RUN9_GLM | PA1 | RUN9 | GLM | TSS | 401 | 93,045 | 59,243 | 0,523 | 0,533 | NA 123 | cervus.global.Alpi_PA1_RUN9_MAXENT | PA1 | RUN9 | MAXENT | ROC | 323,5 | 92,679 | 63,829 | 0,838 | 0,83 | NA 124 | cervus.global.Alpi_PA1_RUN9_MAXENT | PA1 | RUN9 | MAXENT | TSS | 327 | 92,094 | 64,207 | 0,563 | 0,554 | NA 125 | cervus.global.Alpi_PA1_RUN9_MAXNET | PA1 | RUN9 | MAXNET | ROC | 374,5 | 87,335 | 67,279 | 0,828 | 0,829 | NA 126 | cervus.global.Alpi_PA1_RUN9_MAXNET | PA1 | RUN9 | MAXNET | TSS | 369 | 87,775 | 66,657 | 0,545 | 0,547 | NA 127 | cervus.global.Alpi_PA1_RUN10_CTA | PA1 | RUN10 | CTA | ROC | 402 | 93,411 | 60,714 | 0,801 | 0,805 | NA 128 | cervus.global.Alpi_PA1_RUN10_CTA | PA1 | RUN10 | CTA | TSS | 403 | 93,411 | 60,714 | 0,541 | 0,534 | NA 129 | cervus.global.Alpi_PA1_RUN10_FDA | PA1 | RUN10 | FDA | ROC | 336,5 | 92,313 | 59,85 | 0,815 | 0,824 | NA 130 | cervus.global.Alpi_PA1_RUN10_FDA | PA1 | RUN10 | FDA | TSS | 330 | 93,485 | 58,386 | 0,519 | 0,525 | NA 131 | cervus.global.Alpi_PA1_RUN10_GAM | PA1 | RUN10 | GAM | ROC | 392,5 | 91,215 | 61,436 | 0,815 | 0,823 | NA 132 | cervus.global.Alpi_PA1_RUN10_GAM | PA1 | RUN10 | GAM | TSS | 394 | 91,069 | 61,493 | 0,526 | 0,522 | NA 133 | cervus.global.Alpi_PA1_RUN10_GBM | PA1 | RUN10 | GBM | ROC | 452,5 | 93,119 | 61,521 | 0,828 | 0,824 | NA 134 | cervus.global.Alpi_PA1_RUN10_GBM | PA1 | RUN10 | GBM | TSS | 486 | 89,605 | 64,914 | 0,546 | 0,541 | NA 135 | cervus.global.Alpi_PA1_RUN10_GLM | PA1 | RUN10 | GLM | ROC | 425,5 | 92,02 | 60,521 | 0,818 | 0,825 | NA 136 | cervus.global.Alpi_PA1_RUN10_GLM | PA1 | RUN10 | GLM | TSS | 423 | 92,167 | 60,3 | 0,525 | 0,531 | NA 137 | cervus.global.Alpi_PA1_RUN10_MAXENT | PA1 | RUN10 | MAXENT | ROC | 331,5 | 92,167 | 63,957 | 0,836 | 0,828 | NA 138 | cervus.global.Alpi_PA1_RUN10_MAXENT | PA1 | RUN10 | MAXENT | TSS | 333 | 91,801 | 64,064 | 0,56 | 0,556 | NA 139 | cervus.global.Alpi_PA1_RUN10_MAXNET | PA1 | RUN10 | MAXNET | ROC | 348,5 | 89,751 | 65,25 | 0,829 | 0,829 | NA 140 | cervus.global.Alpi_PA1_RUN10_MAXNET | PA1 | RUN10 | MAXNET | TSS | 322 | 91,947 | 62,814 | 0,548 | 0,547 | NA 141 | cervus.global.Alpi_PA1_RUN11_CTA | PA1 | RUN11 | CTA | ROC | 472 | 93,192 | 61,886 | 0,798 | 0,798 | NA 142 | cervus.global.Alpi_PA1_RUN11_CTA | PA1 | RUN11 | CTA | TSS | 472 | 93,192 | 61,886 | 0,551 | 0,538 | NA 143 | cervus.global.Alpi_PA1_RUN11_FDA | PA1 | RUN11 | FDA | ROC | 331,5 | 93,265 | 58,086 | 0,815 | 0,824 | NA 144 | cervus.global.Alpi_PA1_RUN11_FDA | PA1 | RUN11 | FDA | TSS | 347 | 89,751 | 61,207 | 0,512 | 0,533 | NA 145 | cervus.global.Alpi_PA1_RUN11_GAM | PA1 | RUN11 | GAM | ROC | 402,5 | 90,044 | 61,971 | 0,815 | 0,825 | NA 146 | cervus.global.Alpi_PA1_RUN11_GAM | PA1 | RUN11 | GAM | TSS | 381 | 92,167 | 59,821 | 0,519 | 0,537 | NA 147 | cervus.global.Alpi_PA1_RUN11_GBM | PA1 | RUN11 | GBM | ROC | 479,5 | 91,947 | 63,271 | 0,828 | 0,827 | NA 148 | cervus.global.Alpi_PA1_RUN11_GBM | PA1 | RUN11 | GBM | TSS | 479 | 92,167 | 62,757 | 0,552 | 0,554 | NA 149 | cervus.global.Alpi_PA1_RUN11_GLM | PA1 | RUN11 | GLM | ROC | 440,5 | 91,069 | 61,45 | 0,818 | 0,826 | NA 150 | cervus.global.Alpi_PA1_RUN11_GLM | PA1 | RUN11 | GLM | TSS | 436 | 91,288 | 61,064 | 0,524 | 0,544 | NA 151 | cervus.global.Alpi_PA1_RUN11_MAXENT | PA1 | RUN11 | MAXENT | ROC | 345,5 | 90,41 | 66,436 | 0,841 | 0,827 | NA 152 | cervus.global.Alpi_PA1_RUN11_MAXENT | PA1 | RUN11 | MAXENT | TSS | 327 | 92,679 | 64,079 | 0,567 | 0,552 | NA 153 | cervus.global.Alpi_PA1_RUN11_MAXNET | PA1 | RUN11 | MAXNET | ROC | 322,5 | 92,24 | 62,479 | 0,829 | 0,832 | NA 154 | cervus.global.Alpi_PA1_RUN11_MAXNET | PA1 | RUN11 | MAXNET | TSS | 321 | 92,387 | 62,257 | 0,547 | 0,555 | NA 155 | cervus.global.Alpi_PA1_RUN12_CTA | PA1 | RUN12 | CTA | ROC | 388 | 93,777 | 60,379 | 0,8 | 0,794 | NA 156 | cervus.global.Alpi_PA1_RUN12_CTA | PA1 | RUN12 | CTA | TSS | 386 | 93,777 | 60,379 | 0,542 | 0,538 | NA 157 | cervus.global.Alpi_PA1_RUN12_FDA | PA1 | RUN12 | FDA | ROC | 351,5 | 89,165 | 63,229 | 0,819 | 0,81 | NA 158 | cervus.global.Alpi_PA1_RUN12_FDA | PA1 | RUN12 | FDA | TSS | 353 | 88,946 | 63,436 | 0,524 | 0,506 | NA 159 | cervus.global.Alpi_PA1_RUN12_GAM | PA1 | RUN12 | GAM | ROC | 381,5 | 92,02 | 60,529 | 0,819 | 0,811 | NA 160 | cervus.global.Alpi_PA1_RUN12_GAM | PA1 | RUN12 | GAM | TSS | 441 | 86,457 | 65,814 | 0,524 | 0,503 | NA 161 | cervus.global.Alpi_PA1_RUN12_GBM | PA1 | RUN12 | GBM | ROC | 491,5 | 89,092 | 66,3 | 0,832 | 0,816 | NA 162 | cervus.global.Alpi_PA1_RUN12_GBM | PA1 | RUN12 | GBM | TSS | 492 | 89,092 | 66,3 | 0,552 | 0,517 | NA 163 | cervus.global.Alpi_PA1_RUN12_GLM | PA1 | RUN12 | GLM | ROC | 432,5 | 91,728 | 61,564 | 0,823 | 0,813 | NA 164 | cervus.global.Alpi_PA1_RUN12_GLM | PA1 | RUN12 | GLM | TSS | 433 | 91,728 | 61,564 | 0,532 | 0,526 | NA 165 | cervus.global.Alpi_PA1_RUN12_MAXENT | PA1 | RUN12 | MAXENT | ROC | 341,5 | 89,165 | 68,086 | 0,842 | 0,818 | NA 166 | cervus.global.Alpi_PA1_RUN12_MAXENT | PA1 | RUN12 | MAXENT | TSS | 343 | 88,873 | 68,136 | 0,569 | 0,516 | NA 167 | cervus.global.Alpi_PA1_RUN12_MAXNET | PA1 | RUN12 | MAXNET | ROC | 342,5 | 88,799 | 65,693 | 0,833 | 0,822 | NA 168 | cervus.global.Alpi_PA1_RUN12_MAXNET | PA1 | RUN12 | MAXNET | TSS | 342 | 88,799 | 65,607 | 0,545 | 0,54 | NA 169 | cervus.global.Alpi_PA1_RUN13_CTA | PA1 | RUN13 | CTA | ROC | 394 | 93,997 | 59,907 | 0,803 | 0,798 | NA 170 | cervus.global.Alpi_PA1_RUN13_CTA | PA1 | RUN13 | CTA | TSS | 393 | 93,997 | 59,907 | 0,539 | 0,53 | NA 171 | cervus.global.Alpi_PA1_RUN13_FDA | PA1 | RUN13 | FDA | ROC | 333,5 | 92,972 | 59,036 | 0,818 | 0,817 | NA 172 | cervus.global.Alpi_PA1_RUN13_FDA | PA1 | RUN13 | FDA | TSS | 334 | 92,972 | 59,036 | 0,519 | 0,526 | NA 173 | cervus.global.Alpi_PA1_RUN13_GAM | PA1 | RUN13 | GAM | ROC | 384,5 | 91,581 | 60,786 | 0,818 | 0,817 | NA 174 | cervus.global.Alpi_PA1_RUN13_GAM | PA1 | RUN13 | GAM | TSS | 385 | 91,581 | 60,786 | 0,522 | 0,535 | NA 175 | cervus.global.Alpi_PA1_RUN13_GBM | PA1 | RUN13 | GBM | ROC | 446 | 93,924 | 61,043 | 0,831 | 0,814 | NA 176 | cervus.global.Alpi_PA1_RUN13_GBM | PA1 | RUN13 | GBM | TSS | 442 | 94,07 | 60,714 | 0,548 | 0,539 | NA 177 | cervus.global.Alpi_PA1_RUN13_GLM | PA1 | RUN13 | GLM | ROC | 410,5 | 93,338 | 59,614 | 0,822 | 0,816 | NA 178 | cervus.global.Alpi_PA1_RUN13_GLM | PA1 | RUN13 | GLM | TSS | 410 | 93,338 | 59,571 | 0,53 | 0,53 | NA 179 | cervus.global.Alpi_PA1_RUN13_MAXENT | PA1 | RUN13 | MAXENT | ROC | 307,5 | 93,119 | 63,643 | 0,843 | 0,819 | NA 180 | cervus.global.Alpi_PA1_RUN13_MAXENT | PA1 | RUN13 | MAXENT | TSS | 310 | 92,826 | 63,907 | 0,566 | 0,543 | NA 181 | cervus.global.Alpi_PA1_RUN13_MAXNET | PA1 | RUN13 | MAXNET | ROC | 317,5 | 91,581 | 63,1 | 0,833 | 0,822 | NA 182 | cervus.global.Alpi_PA1_RUN13_MAXNET | PA1 | RUN13 | MAXNET | TSS | 323 | 90,922 | 63,571 | 0,546 | 0,552 | NA 183 | cervus.global.Alpi_PA1_RUN14_CTA | PA1 | RUN14 | CTA | ROC | 404 | 93,997 | 60,729 | 0,804 | 0,794 | NA 184 | cervus.global.Alpi_PA1_RUN14_CTA | PA1 | RUN14 | CTA | TSS | 404 | 93,997 | 60,729 | 0,547 | 0,516 | NA 185 | cervus.global.Alpi_PA1_RUN14_FDA | PA1 | RUN14 | FDA | ROC | 332,5 | 93,338 | 59,593 | 0,818 | 0,815 | NA 186 | cervus.global.Alpi_PA1_RUN14_FDA | PA1 | RUN14 | FDA | TSS | 332 | 93,558 | 59,314 | 0,529 | 0,506 | NA 187 | cervus.global.Alpi_PA1_RUN14_GAM | PA1 | RUN14 | GAM | ROC | 389,5 | 91,728 | 61,543 | 0,818 | 0,816 | NA 188 | cervus.global.Alpi_PA1_RUN14_GAM | PA1 | RUN14 | GAM | TSS | 385 | 92,02 | 61,064 | 0,532 | 0,515 | NA 189 | cervus.global.Alpi_PA1_RUN14_GBM | PA1 | RUN14 | GBM | ROC | 484,5 | 92,24 | 63,693 | 0,831 | 0,816 | NA 190 | cervus.global.Alpi_PA1_RUN14_GBM | PA1 | RUN14 | GBM | TSS | 483 | 92,387 | 63,521 | 0,559 | 0,524 | NA 191 | cervus.global.Alpi_PA1_RUN14_GLM | PA1 | RUN14 | GLM | ROC | 423,5 | 92,972 | 60,971 | 0,822 | 0,815 | NA 192 | cervus.global.Alpi_PA1_RUN14_GLM | PA1 | RUN14 | GLM | TSS | 412 | 93,704 | 60,179 | 0,539 | 0,511 | NA 193 | cervus.global.Alpi_PA1_RUN14_MAXENT | PA1 | RUN14 | MAXENT | ROC | 332,5 | 92,46 | 64,921 | 0,842 | 0,822 | NA 194 | cervus.global.Alpi_PA1_RUN14_MAXENT | PA1 | RUN14 | MAXENT | TSS | 333 | 92,46 | 64,921 | 0,573 | 0,537 | NA 195 | cervus.global.Alpi_PA1_RUN14_MAXNET | PA1 | RUN14 | MAXNET | ROC | 359,5 | 89,165 | 66,357 | 0,831 | 0,825 | NA 196 | cervus.global.Alpi_PA1_RUN14_MAXNET | PA1 | RUN14 | MAXNET | TSS | 358 | 89,239 | 66,1 | 0,554 | 0,54 | NA 197 | cervus.global.Alpi_PA1_RUN15_CTA | PA1 | RUN15 | CTA | ROC | 386 | 94,143 | 61,064 | 0,804 | 0,783 | NA 198 | cervus.global.Alpi_PA1_RUN15_CTA | PA1 | RUN15 | CTA | TSS | 387 | 94,143 | 61,064 | 0,552 | 0,514 | NA 199 | cervus.global.Alpi_PA1_RUN15_FDA | PA1 | RUN15 | FDA | ROC | 329,5 | 93,631 | 58,45 | 0,818 | 0,815 | NA 200 | cervus.global.Alpi_PA1_RUN15_FDA | PA1 | RUN15 | FDA | TSS | 339 | 91,508 | 60,279 | 0,519 | 0,502 | NA 201 | cervus.global.Alpi_PA1_RUN15_GAM | PA1 | RUN15 | GAM | ROC | 373,5 | 92,826 | 59,786 | 0,819 | 0,815 | NA 202 | cervus.global.Alpi_PA1_RUN15_GAM | PA1 | RUN15 | GAM | TSS | 375 | 92,679 | 59,857 | 0,526 | 0,506 | NA 203 | cervus.global.Alpi_PA1_RUN15_GBM | PA1 | RUN15 | GBM | ROC | 461,5 | 92,533 | 63,229 | 0,832 | 0,817 | NA 204 | cervus.global.Alpi_PA1_RUN15_GBM | PA1 | RUN15 | GBM | TSS | 446 | 93,924 | 61,714 | 0,557 | 0,515 | NA 205 | cervus.global.Alpi_PA1_RUN15_GLM | PA1 | RUN15 | GLM | ROC | 439,5 | 91,654 | 62,079 | 0,822 | 0,817 | NA 206 | cervus.global.Alpi_PA1_RUN15_GLM | PA1 | RUN15 | GLM | TSS | 435 | 91,801 | 61,7 | 0,536 | 0,511 | NA 207 | cervus.global.Alpi_PA1_RUN15_MAXENT | PA1 | RUN15 | MAXENT | ROC | 313,5 | 92,167 | 64,2 | 0,842 | 0,823 | NA 208 | cervus.global.Alpi_PA1_RUN15_MAXENT | PA1 | RUN15 | MAXENT | TSS | 324 | 90,63 | 65,521 | 0,561 | 0,525 | NA 209 | cervus.global.Alpi_PA1_RUN15_MAXNET | PA1 | RUN15 | MAXNET | ROC | 390,5 | 85,578 | 69,657 | 0,832 | 0,823 | NA 210 | cervus.global.Alpi_PA1_RUN15_MAXNET | PA1 | RUN15 | MAXNET | TSS | 329 | 90,776 | 64,321 | 0,551 | 0,521 | NA 211 | cervus.global.Alpi_PA1_RUN16_CTA | PA1 | RUN16 | CTA | ROC | 437,5 | 92,899 | 61,693 | 0,804 | 0,797 | NA 212 | cervus.global.Alpi_PA1_RUN16_CTA | PA1 | RUN16 | CTA | TSS | 435 | 92,899 | 61,693 | 0,546 | 0,527 | NA 213 | cervus.global.Alpi_PA1_RUN16_FDA | PA1 | RUN16 | FDA | ROC | 352,5 | 88,946 | 63,321 | 0,818 | 0,816 | NA 214 | cervus.global.Alpi_PA1_RUN16_FDA | PA1 | RUN16 | FDA | TSS | 334 | 92,899 | 59,036 | 0,52 | 0,507 | NA 215 | cervus.global.Alpi_PA1_RUN16_GAM | PA1 | RUN16 | GAM | ROC | 378,5 | 92,46 | 60,364 | 0,818 | 0,817 | NA 216 | cervus.global.Alpi_PA1_RUN16_GAM | PA1 | RUN16 | GAM | TSS | 375 | 92,753 | 60,014 | 0,526 | 0,512 | NA 217 | cervus.global.Alpi_PA1_RUN16_GBM | PA1 | RUN16 | GBM | ROC | 472,5 | 93,485 | 62,343 | 0,83 | 0,816 | NA 218 | cervus.global.Alpi_PA1_RUN16_GBM | PA1 | RUN16 | GBM | TSS | 458 | 94,51 | 61,157 | 0,557 | 0,518 | NA 219 | cervus.global.Alpi_PA1_RUN16_GLM | PA1 | RUN16 | GLM | ROC | 424,5 | 92,387 | 61,15 | 0,821 | 0,819 | NA 220 | cervus.global.Alpi_PA1_RUN16_GLM | PA1 | RUN16 | GLM | TSS | 422 | 92,533 | 60,857 | 0,535 | 0,517 | NA 221 | cervus.global.Alpi_PA1_RUN16_MAXENT | PA1 | RUN16 | MAXENT | ROC | 342,5 | 90,703 | 66,457 | 0,843 | 0,822 | NA 222 | cervus.global.Alpi_PA1_RUN16_MAXENT | PA1 | RUN16 | MAXENT | TSS | 344 | 90,483 | 66,607 | 0,571 | 0,512 | NA 223 | cervus.global.Alpi_PA1_RUN16_MAXNET | PA1 | RUN16 | MAXNET | ROC | 361,5 | 88,726 | 66,7 | 0,832 | 0,823 | NA 224 | cervus.global.Alpi_PA1_RUN16_MAXNET | PA1 | RUN16 | MAXNET | TSS | 360 | 88,799 | 66,457 | 0,553 | 0,521 | NA 225 | cervus.global.Alpi_PA1_RUN17_CTA | PA1 | RUN17 | CTA | ROC | 378,5 | 93,704 | 60,7 | 0,8 | 0,789 | NA 226 | cervus.global.Alpi_PA1_RUN17_CTA | PA1 | RUN17 | CTA | TSS | 379 | 93,704 | 60,7 | 0,544 | 0,524 | NA 227 | cervus.global.Alpi_PA1_RUN17_FDA | PA1 | RUN17 | FDA | ROC | 332,5 | 93,265 | 59,4 | 0,818 | 0,818 | NA 228 | cervus.global.Alpi_PA1_RUN17_FDA | PA1 | RUN17 | FDA | TSS | 332 | 93,338 | 59,229 | 0,527 | 0,512 | NA 229 | cervus.global.Alpi_PA1_RUN17_GAM | PA1 | RUN17 | GAM | ROC | 387,5 | 91,435 | 61,486 | 0,818 | 0,818 | NA 230 | cervus.global.Alpi_PA1_RUN17_GAM | PA1 | RUN17 | GAM | TSS | 394 | 90,703 | 62,129 | 0,528 | 0,513 | NA 231 | cervus.global.Alpi_PA1_RUN17_GBM | PA1 | RUN17 | GBM | ROC | 441,5 | 92,753 | 62,514 | 0,831 | 0,817 | NA 232 | cervus.global.Alpi_PA1_RUN17_GBM | PA1 | RUN17 | GBM | TSS | 442 | 92,753 | 62,514 | 0,552 | 0,526 | NA 233 | cervus.global.Alpi_PA1_RUN17_GLM | PA1 | RUN17 | GLM | ROC | 427,5 | 92,094 | 61,336 | 0,822 | 0,814 | NA 234 | cervus.global.Alpi_PA1_RUN17_GLM | PA1 | RUN17 | GLM | TSS | 425 | 92,167 | 61,121 | 0,534 | 0,516 | NA 235 | cervus.global.Alpi_PA1_RUN17_MAXENT | PA1 | RUN17 | MAXENT | ROC | 314,5 | 91,362 | 65,05 | 0,843 | 0,819 | NA 236 | cervus.global.Alpi_PA1_RUN17_MAXENT | PA1 | RUN17 | MAXENT | TSS | 328 | 89,898 | 66,35 | 0,563 | 0,529 | NA 237 | cervus.global.Alpi_PA1_RUN17_MAXNET | PA1 | RUN17 | MAXNET | ROC | 383,5 | 85,505 | 69,779 | 0,832 | 0,822 | NA 238 | cervus.global.Alpi_PA1_RUN17_MAXNET | PA1 | RUN17 | MAXNET | TSS | 383 | 85,505 | 69,707 | 0,553 | 0,519 | NA 239 | cervus.global.Alpi_PA1_RUN18_CTA | PA1 | RUN18 | CTA | ROC | 407 | 93,119 | 60,857 | 0,803 | 0,802 | NA 240 | cervus.global.Alpi_PA1_RUN18_CTA | PA1 | RUN18 | CTA | TSS | 406 | 93,119 | 60,857 | 0,54 | 0,534 | NA 241 | cervus.global.Alpi_PA1_RUN18_FDA | PA1 | RUN18 | FDA | ROC | 331,5 | 92,972 | 59,093 | 0,815 | 0,822 | NA 242 | cervus.global.Alpi_PA1_RUN18_FDA | PA1 | RUN18 | FDA | TSS | 330 | 93,265 | 58,607 | 0,52 | 0,522 | NA 243 | cervus.global.Alpi_PA1_RUN18_GAM | PA1 | RUN18 | GAM | ROC | 393,5 | 90,776 | 61,543 | 0,815 | 0,823 | NA 244 | cervus.global.Alpi_PA1_RUN18_GAM | PA1 | RUN18 | GAM | TSS | 393 | 90,849 | 61,464 | 0,523 | 0,529 | NA 245 | cervus.global.Alpi_PA1_RUN18_GBM | PA1 | RUN18 | GBM | ROC | 477,5 | 91,728 | 62,879 | 0,828 | 0,827 | NA 246 | cervus.global.Alpi_PA1_RUN18_GBM | PA1 | RUN18 | GBM | TSS | 474 | 91,874 | 62,479 | 0,543 | 0,55 | NA 247 | cervus.global.Alpi_PA1_RUN18_GLM | PA1 | RUN18 | GLM | ROC | 401,5 | 93,924 | 58,886 | 0,818 | 0,823 | NA 248 | cervus.global.Alpi_PA1_RUN18_GLM | PA1 | RUN18 | GLM | TSS | 416 | 92,606 | 59,993 | 0,527 | 0,527 | NA 249 | cervus.global.Alpi_PA1_RUN18_MAXENT | PA1 | RUN18 | MAXENT | ROC | 309,5 | 92,606 | 62,9 | 0,839 | 0,829 | NA 250 | cervus.global.Alpi_PA1_RUN18_MAXENT | PA1 | RUN18 | MAXENT | TSS | 308 | 92,753 | 62,657 | 0,554 | 0,548 | NA 251 | cervus.global.Alpi_PA1_RUN18_MAXNET | PA1 | RUN18 | MAXNET | ROC | 349,5 | 89,019 | 65,236 | 0,829 | 0,83 | NA 252 | cervus.global.Alpi_PA1_RUN18_MAXNET | PA1 | RUN18 | MAXNET | TSS | 349 | 89,092 | 65,121 | 0,543 | 0,555 | NA 253 | cervus.global.Alpi_PA1_RUN19_CTA | PA1 | RUN19 | CTA | ROC | 412 | 93,631 | 60,986 | 0,806 | 0,791 | NA 254 | cervus.global.Alpi_PA1_RUN19_CTA | PA1 | RUN19 | CTA | TSS | 408,5 | 93,631 | 60,986 | 0,546 | 0,523 | NA 255 | cervus.global.Alpi_PA1_RUN19_FDA | PA1 | RUN19 | FDA | ROC | 332,5 | 93,485 | 58,864 | 0,82 | 0,813 | NA 256 | cervus.global.Alpi_PA1_RUN19_FDA | PA1 | RUN19 | FDA | TSS | 349 | 89,531 | 62,457 | 0,52 | 0,51 | NA 257 | cervus.global.Alpi_PA1_RUN19_GAM | PA1 | RUN19 | GAM | ROC | 383,5 | 91,581 | 61,15 | 0,82 | 0,813 | NA 258 | cervus.global.Alpi_PA1_RUN19_GAM | PA1 | RUN19 | GAM | TSS | 375 | 92,167 | 60,271 | 0,525 | 0,525 | NA 259 | cervus.global.Alpi_PA1_RUN19_GBM | PA1 | RUN19 | GBM | ROC | 428,5 | 94,436 | 61,029 | 0,832 | 0,814 | NA 260 | cervus.global.Alpi_PA1_RUN19_GBM | PA1 | RUN19 | GBM | TSS | 426 | 94,436 | 60,914 | 0,554 | 0,533 | NA 261 | cervus.global.Alpi_PA1_RUN19_GLM | PA1 | RUN19 | GLM | ROC | 442,5 | 91,069 | 62,45 | 0,823 | 0,814 | NA 262 | cervus.global.Alpi_PA1_RUN19_GLM | PA1 | RUN19 | GLM | TSS | 438 | 91,362 | 62,093 | 0,535 | 0,514 | NA 263 | cervus.global.Alpi_PA1_RUN19_MAXENT | PA1 | RUN19 | MAXENT | ROC | 318,5 | 92,899 | 64,279 | 0,845 | 0,818 | NA 264 | cervus.global.Alpi_PA1_RUN19_MAXENT | PA1 | RUN19 | MAXENT | TSS | 321 | 92,606 | 64,486 | 0,571 | 0,545 | NA 265 | cervus.global.Alpi_PA1_RUN19_MAXNET | PA1 | RUN19 | MAXNET | ROC | 343,5 | 89,531 | 65,357 | 0,833 | 0,819 | NA 266 | cervus.global.Alpi_PA1_RUN19_MAXNET | PA1 | RUN19 | MAXNET | TSS | 342 | 89,605 | 65,179 | 0,548 | 0,54 | NA 267 | cervus.global.Alpi_PA1_RUN20_CTA | PA1 | RUN20 | CTA | ROC | 429 | 92,606 | 61,336 | 0,807 | 0,797 | NA 268 | cervus.global.Alpi_PA1_RUN20_CTA | PA1 | RUN20 | CTA | TSS | 430 | 92,606 | 61,336 | 0,539 | 0,52 | NA 269 | cervus.global.Alpi_PA1_RUN20_FDA | PA1 | RUN20 | FDA | ROC | 333,5 | 93,265 | 59,414 | 0,819 | 0,815 | NA 270 | cervus.global.Alpi_PA1_RUN20_FDA | PA1 | RUN20 | FDA | TSS | 333 | 93,338 | 59,179 | 0,527 | 0,513 | NA 271 | cervus.global.Alpi_PA1_RUN20_GAM | PA1 | RUN20 | GAM | ROC | 372,5 | 92,972 | 59,936 | 0,819 | 0,815 | NA 272 | cervus.global.Alpi_PA1_RUN20_GAM | PA1 | RUN20 | GAM | TSS | 394 | 90,63 | 62,079 | 0,527 | 0,518 | NA 273 | cervus.global.Alpi_PA1_RUN20_GBM | PA1 | RUN20 | GBM | ROC | 457,5 | 92,826 | 62,479 | 0,83 | 0,818 | NA 274 | cervus.global.Alpi_PA1_RUN20_GBM | PA1 | RUN20 | GBM | TSS | 461 | 92,46 | 62,836 | 0,553 | 0,537 | NA 275 | cervus.global.Alpi_PA1_RUN20_GLM | PA1 | RUN20 | GLM | ROC | 426,5 | 92,24 | 61,271 | 0,823 | 0,815 | NA 276 | cervus.global.Alpi_PA1_RUN20_GLM | PA1 | RUN20 | GLM | TSS | 410 | 93,265 | 59,921 | 0,532 | 0,518 | NA 277 | cervus.global.Alpi_PA1_RUN20_MAXENT | PA1 | RUN20 | MAXENT | ROC | 313,5 | 93,119 | 63,564 | 0,842 | 0,821 | NA 278 | cervus.global.Alpi_PA1_RUN20_MAXENT | PA1 | RUN20 | MAXENT | TSS | 314 | 93,119 | 63,564 | 0,565 | 0,543 | NA 279 | cervus.global.Alpi_PA1_RUN20_MAXNET | PA1 | RUN20 | MAXNET | ROC | 364,5 | 87,335 | 67,55 | 0,832 | 0,825 | NA 280 | cervus.global.Alpi_PA1_RUN20_MAXNET | PA1 | RUN20 | MAXNET | TSS | 376 | 86,237 | 68,579 | 0,548 | 0,544 | NA 

cervus_ensemble_models_global <- BIOMOD_EnsembleModeling(
  bm.mod = cervus_single_models_global,
  models.chosen = "all",
  em.by = "all",
  em.algo = "EMca",
  metric.select = c("ROC"),
  metric.select.thresh = c(0.7),
  metric.eval = c("ROC", "TSS"),
  var.import = 3,
  nb.cpu = 432,
  do.progress = T
)

show(cervus_ensemble_models_global)

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= BIOMOD.ensemble.models.out -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

sp.name : cervus.global.Alpi

expl.var.names : bio_7 bio_10 bio_11 bio_12 bio_14 bio_18

models computed: cervus.global.Alpi_EMcaByROC_mergedData_mergedRun_mergedAlgo

models failed: none

-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=

ensemble_scores <- get_evaluations(cervus_ensemble_models_global)

<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns="http://www.w3.org/TR/REC-html40">

  | full.name | merged.by.PA | merged.by.run | merged.by.algo | filtered.by | algo | metric.eval | cutoff | sensitivity | specificity | calibration | validation | evaluation -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- | -- 1 | cervus.global.Alpi_EMcaByROC_mergedData_mergedRun_mergedAlgo | mergedData | mergedRun | mergedAlgo | ROC | EMca | ROC | 725 | 89,6 | 65,875 | 0,813 | NA | NA 2 | cervus.global.Alpi_EMcaByROC_mergedData_mergedRun_mergedAlgo | mergedData | mergedRun | mergedAlgo | ROC | EMca | TSS | 727 | 89,6 | 65,875 | 0,555 | NA | NA 

sessionInfo()
R version 4.3.2 (2023-10-31 ucrt)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows 11 x64 (build 22631)

Matrix products: default

locale:
[1] LC_COLLATE=Italian_Italy.utf8  LC_CTYPE=Italian_Italy.utf8   
[3] LC_MONETARY=Italian_Italy.utf8 LC_NUMERIC=C                  
[5] LC_TIME=Italian_Italy.utf8    

time zone: Europe/Berlin
tzcode source: internal

attached base packages:
[1] splines   stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
 [1] xgboost_1.7.7.1         randomForest_4.7-1.1    maxnet_0.1.4           
 [4] earth_5.3.2             plotmo_3.6.2            TeachingDemos_2.12     
 [7] plotrix_3.8-4           Formula_1.2-5           gbm_2.1.9              
[10] mgcv_1.9-1              nlme_3.1-163            gam_1.22-3             
[13] foreach_1.5.2           mda_0.5-4               class_7.3-22           
[16] rpart_4.1.21            nnet_7.3-19             biomod2_4.2-5          
[19] usdm_2.1-7              geodata_0.5-9           terra_1.7-71           
[22] biosurvey_0.1.2         CoordinateCleaner_3.0.1 data.table_1.15.0      
[25] rgbif_3.7.9            

loaded via a namespace (and not attached):
 [1] DBI_1.2.1              rgeos_0.6-4            deldir_2.0-2          
 [4] pROC_1.18.5            permute_0.9-7          rlang_1.1.3           
 [7] magrittr_2.0.3         e1071_1.7-14           compiler_4.3.2        
[10] spatstat.geom_3.2-8    vctrs_0.6.5            maps_3.4.2            
[13] reshape2_1.4.4         stringr_1.5.1          shape_1.4.6           
[16] pkgconfig_2.0.3        utf8_1.2.4             pracma_2.4.4          
[19] glmnet_4.1-8           jsonlite_1.8.8         PresenceAbsence_1.1.11
[22] reshape_0.8.9          spatstat.utils_3.0-4   parallel_4.3.2        
[25] cluster_2.1.4          R6_2.5.1               stringi_1.8.3         
[28] spatstat.data_3.0-4    diptest_0.77-0         Rcpp_1.0.12           
[31] iterators_1.0.14       picante_1.8.2          Matrix_1.6-5          
[34] tidyselect_1.2.0       rnaturalearth_1.0.1    rstudioapi_0.15.0     
[37] abind_1.4-5            vegan_2.6-4            doParallel_1.0.17     
[40] codetools_0.2-19       lattice_0.21-9         tibble_3.2.1          
[43] plyr_1.8.9             ks_1.14.2              geosphere_1.5-18      
[46] survival_3.5-7         sf_1.0-15              units_0.8-5           
[49] proxy_0.4-27           polyclip_1.10-6        xml2_1.3.6            
[52] mclust_6.0.1           pillar_1.9.0           whisker_0.4.1         
[55] KernSmooth_2.23-22     generics_0.1.3         sp_2.1-2              
[58] ggplot2_3.4.4          munsell_0.5.0          scales_1.3.0          
[61] rgdal_1.6-7            glue_1.7.0             lazyeval_0.2.2        
[64] tools_4.3.2            mvtnorm_1.2-4          grid_4.3.2            
[67] ape_5.7-1              colorspace_2.1-0       raster_3.6-26         
[70] cli_3.6.1              fansi_1.0.6            dplyr_1.1.4           
[73] gtable_0.3.4           oai_0.4.0              digest_0.6.34         
[76] classInt_0.4-10        lifecycle_1.0.4        httr_1.4.7            
[79] MASS_7.3-60
HeleneBlt commented 3 months ago

Hi Lorenzo,

Everything is normal here: an ensemble model is still a "summary" of the different models. You selected all the models here and they aren't very different from each other. You may have better results with EMwmean, as you add the weight for the different models. Also, you ask for 20000PA so you might have some case of overfitting. Finally, you can try to add other variables as habitat variables.

I hope it helps. Hélène

LorenzoBernicchi commented 3 months ago

Hi Helene (I hope that's your name, in case it's not I'm sorry)! Thanks for the quick reply! I will try using the EMwmean, and I will check the eventual differences.

About the PA number: I am following the methodology prescribed in an article to model the "global" distribution of a species over its global range, and they used 20'000 random PAs. May I ask you for a few tips that would help to understand how many PAs should I used (based on the modeling area, the number of presences, etc) and how may I undestand if I am having overfitting issues?

A little edit for an additional question: I noticed that, for every single model, the specificity is pretty low, especially compared to sensitivity. Are there any modeling steps, or other things to change, that might help me increase this specific score?

Thank you in advance for you help, have a nice day!!

HeleneBlt commented 3 months ago

Hi Lorenzo,

First, you can have a look at this vignette. Taking several PA datasets with 3*number of presence points approximately would be a good start. I will advise you to plot your data with the pseudo absences: plot(BIOMOD_data). It will allow you to see if you took an area too big, if you have a good balance,...

For the sensitivity/specificity, changing the PA will certainly have an impact. You will also need to look at your response curves: if there is a variable with a strange behavior. In your case, I will recommend adding some variables and not keeping just climatic variables.

Have a nice day! Hélène (Yes it's my name 😄 )

LorenzoBernicchi commented 3 months ago

Thank you so much for your time and patience! Once again, have a good day! Bye bye!