Improve the performance of parsing the csvs to the player database

csthunes / fantasy-football-project

Project space for a web app enabling the user to play around with NFL football statistics to predict the top fantasy players of the next year.

0 stars 0 forks source link

Improve the performance of parsing the csvs to the player database #9

Open csthunes opened 1 year ago

csthunes commented 1 year ago

Currently it takes 4 minutes and 15 minutes to parse and add sequentially. Each position must wait for the previous year to finish as to not create duplicate players, but we could fire off each position asynchronously and theoretically improve the time to parse to players to the database.