Last x messages don't get scraped

[mdhill]

In this case, 9316 out of 46k. There was a previous occurrence with another group: x may have been zero that time but I couldn't get it to tell me it completed successfully.

Using '--login' from config file Using '--password' from config file Detecting the log-in page... Processing the log-in page... Detecting the log-in page... Detecting the log-in page... Detecting the log-in page... Detecting the log-in page... Detecting the log-in page... Inserted message #46389 by ... Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Skipped 1000 messages we already processed Detecting the log-in page... Detecting the log-in page... Detecting the log-in page... Detecting the log-in page... Traceback (most recent call last): File "./yahoo-groups-backup.py", line 129, in main() File "./yahoo-groups-backup.py", line 125, in main arguments, cfg_args) File "./yahoo-groups-backup.py", line 103, in invoke_subcommand return module.command(args) File "/home/mike/Downloads/yahoogroups/yahoo-groups-backup/yahoo_groups_backup/subcommands/scrape_messages.py", line 50, in command msg = scraper.get_message(cur_message) File "/home/mike/Downloads/yahoogroups/yahoo-groups-backup/yahoo_groups_backup/scraper.py", line 196, in get_message data['rawEmail'] = raw['ygData']['rawEmail'] KeyError: 'ygData'