Closed TheMathNinja closed 2 years ago
The current function was leaving pages out of FFToday scrape. This should fix it.
Ah, I see you also added QB and TE to 2 pages (I didn't on my most recent commit). It would probably be too much for the weekly scrapes (weeks 1 - 18) but we can add logic to accommodate it for the season-long.
I lean slightly against it because the players on page 2 for QB and TE have such low projections; and, in-general, I'de like to limit the number of pages we hit on a site for any given-scrape. But, what do you think? I think an argument could be made for including it because those players would be aggregated in the projections_table()
function. Even so, lean towards omitting but want to hear what you think.
I don't have strong opinions about what happens on offense here. My main opinion is that all 3 pages be included for IDP, since IDP projections are notorious for high variance, since player roles in the defense are less known/consistent than on offense. I'm a completionist at heart and like it being there on offense also, but I'm fine with it just being 3 pages for IDP and keeping QB and TE to 1 page each.
Sounds good--thanks, Mike! We will re-evaluate in the future if the need arises.
I think this should make FFToday scrape complete.