Execute awk function in a reduce task

Currently reduce task is written as general shell script and you can specify your favorite interpreter. And in bred's reducer the code you give will be executed using the interpreter for each key. But since generally speaking there are a lot of keys processed in a reducer, this means so many context switches (external command executions) will be made. Making it possible to call a user defined awk function from inside reducer, which is written in an awk string, would be performance-wise very benefitial.

dakusui / bredxbred

Execute awk function in a reduce task #6