mozilla / jydoop

Efficient Hadoop Map-Reduce in Python
Other
31 stars 19 forks source link

Move the 'mappertype' to job configuration. #42

Closed mreid-moz closed 11 years ago

mreid-moz commented 11 years ago

This means that scripts do not have to implement an extra method to set the mapper type, and it can just be set once in that data source's "setupjob" function. This eases the burden for developing new scripts.

Any scripts already written to specify a mappertype function should continue to work fine, as long as they reference one of the standard jydoop 'setupjob' functions.