search

EricPostMaster / tea-recommender

MIT License
0 stars 0 forks source link

follower_pgs doesn't update #3

Open EricPostMaster opened 1 year ago

EricPostMaster commented 1 year ago

When a user is initially added to the dictionary, a follower_pgs value is populated so the scraper knows the max number pages to scrape for that user. There is not currently a function to update that page count, so if a user gains followers that push their total follower count onto another page, the scraper won't know that. For example, my Steepster profile, EricPostMaster had 0 followers when it was scraped, so it shows 'follower_pgs': 0 even though I now have a follower (yeah, that's right - 1 follower! I'm pretty much a tea influencer.)

EricPostMaster commented 1 year ago

This is a good example of a task that should be its own function so I can just add the function to the get_users method as well as the update_users method.