Rework the method to extract praw submissions from the praw submission generator.
The old method had to take in every submission from the praw submission generator, then exclude submissions by date. For previously downloaded users with long post histories this, could be a very time consuming task made unnecessary if only a few new posts had been made since last download.
This rework uses the generator more efficiently to increase the extraction speed. After each submission is yielded from the generator, the submission date is checked, and if the date is out of the acceptable range the generator iteration is broken and the application proceeds with the next step.
In some tests this sped extraction up by as much as 85%.
Rework the method to extract praw submissions from the praw submission generator.
The old method had to take in every submission from the praw submission generator, then exclude submissions by date. For previously downloaded users with long post histories this, could be a very time consuming task made unnecessary if only a few new posts had been made since last download.
This rework uses the generator more efficiently to increase the extraction speed. After each submission is yielded from the generator, the submission date is checked, and if the date is out of the acceptable range the generator iteration is broken and the application proceeds with the next step.
In some tests this sped extraction up by as much as 85%.