See if the task system can be optimized

[kkysen]

@rinon mentioned that this might be possible, and would help improve multi-threaded performance (just not single-thread performance at all). With Rust, we should be able to optimize this more aggressively without fearing data races.