search

AugustT / CEHCraft

Creating minecraft maps using CEH data
3 stars 3 forks source link

Parallelisation #10

Open AugustT opened 6 years ago

AugustT commented 6 years ago

Given that the world building is an 'embarrassingly parallel' problem there could be some big speed gains here. We should look into multi-core solutions in python, no idea how easy/hard these are. We could then in theory upscale to JASMIN if we wanted to 'go big'.

AugustT commented 6 years ago

If we are ever going to go big we need to figure this one out. I think there is an answer in here somewhere

https://stackoverflow.com/questions/17318643/python-multiprocessing-pool-for-parallel-processing