Feature Request: Start scrape at specific message number

hrenfroe / yahoo-groups-backup

A python script to backup the contents of private Yahoo! groups.

The Unlicense

3 stars 4 forks source link

Feature Request: Start scrape at specific message number #4

Closed groeneveld closed 4 years ago

groeneveld commented 4 years ago

During a large scrape the yahoo api goes down sometimes and crashes the backup program. I need a way to start it back where it left off.

hrenfroe commented 4 years ago

How many messages are in the group? The script should detect and skip messages that it's already scraped, but if you have several hundred thousand I can see it taking a while to pick back up.

groeneveld commented 4 years ago

Ah you're right! My bad.