Preprocessing data is slow

andreiapostoae / dota2-predictor

Tool that predicts the outcome of a Dota 2 game using Machine Learning

MIT License

366 stars 82 forks source link

Preprocessing data is slow #11

Open andreiapostoae opened 7 years ago

andreiapostoae commented 7 years ago

Preprocessing a pd.DataFrame row by row and calculating advantages is painfully slow. Should parallelize the loops as the rows do not interact with each other.

Reference: https://blog.dominodatalab.com/simple-parallelization/