search

mozilla / jydoop

Efficient Hadoop Map-Reduce in Python
Other
31 stars 19 forks source link

doc request: what are the 'ARGS' and how are they implemented? #49

Closed gregglind closed 10 years ago

gregglind commented 10 years ago

In partcular:

make hadoop ARGS="scripts/osdistribution.py outputfile 20130330 20130330"

How do the two date arguments work?

bsmedberg commented 10 years ago

The args are parsed by the setupjob script https://github.com/mozilla/jydoop/blob/master/pylib/telemetryutils.py#L65 and turned into hbase query ranges. Although this is telemetry stuff, which doesn't need/use jydoop any more: http://mreid-moz.github.io/blog/2013/11/06/current-state-of-telemetry-analysis/

gregglind commented 10 years ago

Maybe change the README then, where there are lots of magical looking things peeking through.