search

ceumicrodata / mETL

mito ETL tool
161 stars 41 forks source link

it's very slow to process a 9G txt file's etl #35

Closed not-today closed 7 years ago

not-today commented 8 years ago

is there a fast way to process big files, just map each line ,no reduce

soobrosa commented 7 years ago

You should give a whirl to https://github.com/wunderlist/logsanitizer