Convert "bytes added" and "threshold" metrics to utilize multiprocessing_wrapper

rfaulkner / wikipedia_user_metrics

Wikimedia Foundation E3 Team Analysis Code

Other

9 stars 5 forks source link

Convert "bytes added" and "threshold" metrics to utilize multiprocessing_wrapper #11

Closed rfaulkner closed 11 years ago

rfaulkner commented 11 years ago

These metric definitions currently duplicate code that performs process handling in multiprocessing_wrapper. This also results in the follwoing exception being raised due to improper thread termination:

Exception RuntimeError: RuntimeError('cannot join current thread',) in <Finalize object, dead> ignored

rfaulkner commented 11 years ago

imlpemented for Threshold: https://github.com/rfaulkner/E3_analysis/commit/af555557fc774431bc4109e0e49ceff34c691d24

rfaulkner commented 11 years ago

implemented for bytes added: https://github.com/rfaulkner/E3_analysis/commit/d3e8908032bfd91569e9964f97a90d280fccfe11