search

HenrikBengtsson / doFuture

:rocket: R package: doFuture - Use Foreach to Parallelize via Future Framework
https://doFuture.futureverse.org
84 stars 6 forks source link

Adjust `future.globals.maxSize` for chunk size #26

Closed HenrikBengtsson closed 5 years ago

HenrikBengtsson commented 6 years ago

Analogously to what's done in future.apply (>= 1.0.0):

 o The maximum total size of globals allowed (option 'future.globals.maxSize')
   per future ("chunk") is now scaled up by the number of elements processed by
   the future ("chunk") making the protection approximately invariant to the
   amount of chunking (arguments 'future.scheduling' and 'future.chunk.size').

See also https://github.com/HenrikBengtsson/future.apply/issues/8