search

benchflow / data-transformers

Spark scripts utilised to transform data to the BenchFlow internal formats
Other
0 stars 0 forks source link

Parallelize scripts via Python threading #54

Closed Cerfoglg closed 8 years ago

Cerfoglg commented 8 years ago

Whenever possible, use the threading module in Python to parallelize execution when dealing for example with transforming data from multiple indipendent files.