Big data set causing R to crash when using "identify_neighbourhoods" with "hierarchical" method

TrigosTeam / SPIAT

https://trigosteam.github.io/SPIAT/

Artistic License 2.0

20 stars 7 forks source link

Big data set causing R to crash when using "identify_neighbourhoods" with "hierarchical" method #28

Closed ayhanxian closed 7 months ago

ayhanxian commented 11 months ago

Hi Yuzhou,

When executing the function "identify_neighbourhoods" using the method "hierarchical" on a large dataset (~500,000 rows observation(, R would crash.

fuerzhou commented 7 months ago

Hi @ayhanxian,

If you encounter memory issue, try adjusting the Rstudio memory limit by changing the R_MAX_VSIZE variable in the .Renviron file. Please refer to this thread on Stackoverflow.

Alternatively, you could use "dbscan" instead of "hierarchical" method. Please exploring different parameter values that work best for you dataset.

Yuzhou