prioritizr / aoh

Create Area of Habitat Data
https://prioritizr.github.io/aoh
8 stars 1 forks source link

Clarification #23

Closed ctelhado closed 2 years ago

ctelhado commented 2 years ago

https://github.com/prioritizr/aoh/blob/ae92b467770035d6c03170505bf54b64fcbbdce5/vignettes/aoh.Rmd#L215

I think this question is a bit confusing. The tutorial shows how to create AOH for the complete/global range of a single species or few (4) species without issues related to computer power. I think here you want to explain the difficulties around scaling that up to hundreds/thousands species, no? So, do you mean "Can I produce Area of Habitat data for multiple species globally?" (or anything similar to several)

Swap birds for multiple species / all species of a class / thousands of species? Or is the recommendation just for birds? "Additionally, to improve performance when processing data for multiple species globally (e.g., all bird species), it is recommended to split the full dataset into multiple chunks (e.g., six chunks) and process each of these separately."

jeffreyhanson commented 2 years ago

Thanks! Yeah, this FAQ was meant to be about processing data for thousands of species globally (e.g., all amphibians, birds, or mammals). Yeah. the recommendation was specifically for processing all birds globally. If you have >16GB RAM, I don't think chunking is needed for processing amphibians, mammals, or reptiles. I'll update the FAQ to make this clearer (see below). @ctelhado, how does this sound?

Can I produce Area of Habitat data for thousands of species globally?

Yes, the package can generate Area of Habitat data for all terrestrial amphibians, mammals, birds, and reptiles. To accomplish this, you will need a system with at least 16 Gb RAM and 65 Gb disk space. The processing could a couple of days (e.g., if processing all amphibian species) or weeks (e.g., if processing all bird species) to complete. An example script for processing global data is available on the online code repository (see here). Additionally, since a lot of memory is required to process data for all bird species globally, it is recommended to split the full dataset containing all bird species into multiple chunks (e.g., six chunks) and process each of these chunks separately.

ctelhado commented 2 years ago

That makes a lot of sense now!

From: Jeff Hanson @.> Sent: 11 May 2022 22:00 To: prioritizr/aoh @.> Cc: Cristina Telhado @.>; Author @.> Subject: Re: [prioritizr/aoh] Clarification (Issue #23)

Thanks! Yeah, this FAQ was meant to be about processing data for thousands of species globally (e.g., all amphibians, birds, or mammals). Yeah. the recommendation was specifically for processing all birds globally. If you have >16GB RAM, I don't think chunking is needed for processing amphibians, mammals, or reptiles. I've updated the FAQ to mak this clearer:

Can I produce Area of Habitat data for thousands of species globally?

Yes, the package can generate Area of Habitat data for all terrestrial amphibians, mammals, birds, and reptiles. To accomplish this, you will need a system with at least 16 Gb RAM and 65 Gb disk space. The processing could a couple of days (e.g., if processing all amphibian species) or weeks (e.g., if processing all bird species) to complete. An example script for processing global data is available on the online code repository (see herehttps://url6b.mailanyone.net/v1/?m=1notRP-0008gT-5b&i=57e1b682&c=Dc7AMZZGLl6LAcwgYW54y-4RFygt1iyc7-JY59SHViPRndzEcHWaFnkpgBbvCL834OjG0MQ-yRTh9ZxOb4lbI8MnwuXYtYV6QT45jLTlC_f_07D8Lmg-eNoi6bo-k-UAzD04UBPaEv9CloCewoD-8AbTHwWJfrdJUbXOd_X-Hqisu-jXNgFH9Edpz_733A_UL-Ljkl_jgeVQ6SrtMDEdHa64APc5oHfyANU6llyPeUFrcNyGZJW81abhAhZr-_-i). Additionally, since a lot of memory is required to process data for all bird species globally, it is recommended to split the full dataset containing all bird species into multiple chunks (e.g., six chunks) and process each of these chunks separately.

— Reply to this email directly, view it on GitHubhttps://url6b.mailanyone.net/v1/?m=1notRP-0008gT-5b&i=57e1b682&c=-18Lq4gSqtwq0B6K1VFpIXgwQqS8EmKmuLmZAkcbZefxOaxRne5lsCpvuW2uZ-cDIxzm4YjttCeydmqqi0ger27NoXXJchV9u2GRn93jOPZvUCNUq6pn2OIy-AxEy5RnEIboaisMvLEuHRiYO--XDrPWkFBHCGQaMEHNV0gOmV-PkdEtJ7L3qtfTUsaEp194p9em7rn9JlhMLGNtcBw0zeoDjH4BlUh5gSmfIK5wOh_Kw8qI1Tg9PrHl7XnLnTnlyILNumkvrNX3UG2LJOsftw, or unsubscribehttps://url6b.mailanyone.net/v1/?m=1notRP-0008gT-5b&i=57e1b682&c=0g0r5DIcY_1pH-WgPjBSaok8WG-Xn6Ki7f719tr1i5R-1yIzj2AYGc9U8_Q2Qn0YlkOAibUSIwmmU4SvBEiZaNlps7I3zKedmojPCIwv1TsTdzkKXAC09FW3EirM-bhZ5CWA_vcyEJTuFYS3f5BEVyrtG2YQIXvjkQHQ5Bfp_tOygzwvs5L_iXi8VWMA-2MsNTg12KiCnVh0MVYK2jgjVzeHYCvllYf7nB6NhdtLF1q0N90gBFJ9c33JgM-YvRRqzwnn-Op27tcrm0c3pyyE9o_l4d9ssrLUlqewOuTF8Zc. You are receiving this because you authored the thread.Message ID: @.**@.>>

jeffreyhanson commented 2 years ago

Brilliant - thanks!