adamhaney / lispy

An implementation of scheme that can call python modules
21 stars 4 forks source link

Add automatic parallelization of maps and nested forms #6

Open adamhaney opened 11 years ago

adamhaney commented 11 years ago

Currently python is plagued by the GIL, wouldn't it be nice if we broadcast s-expressions to eager mapping interpreters so that they could be evaluated outside the GIL?

Proposed approach:

adamhaney commented 11 years ago

@joshmarlow and I have discussed this idea further and currently there are two pieces needed in order to implement multiple worker processes:

  1. A scheduler which can decide where work should be sent
  2. A worker object that can run locally, remotely or in a public cloud