search

dmaclean / dfs-python

Tools for DFS data collection and projection creation.
11 stars 2 forks source link

Modify the BBR scraper to only collect info for last night's players #12

Closed dmaclean closed 10 years ago

dmaclean commented 10 years ago

The scraper takes a long time and most of the data being scraped is for data that won't change anyways. We should try to use the _get_gamelist() and _get_players_ingame() from projections.py.

dmaclean commented 10 years ago

Done. _get_gamelist() and _get_players_ingame() are now in effect and we're no longer checking every player. Also, because of this, I found a bug in _get_players_ingame(). Before, it wasn't taking into account that some players on a team won't have a _game_totalsbasic or _game_totalsadvanced entry if they didn't play. Therefore, checking by max date won't pick up all players. Now, we're just making sure the team they're on for their last game is one of the two teams we're looking for at the moment.

Files modified: