Load data w/ multiple sort orders to fetch more than 1k comments from the API

[arye321]

First thank you for this, works perfect. well done!

Would it be possible to add the ability to backup users top posts instead of sorting by 'new' ?

this could add some more data to the db

edit: I noticed theres a 'controversial' (new, top, controversial) sorting as well

[xavdid]

Thank you for the kind words!

Yes, that wouldn't be hard to add.

If you're archiving your own data, the best way is to get your GDPR archive and run it through the tool (see docs), which will capture every post and comment.

For other users, leveraging the other sort methods would indeed allow for fetching more than 1k posts, though I'm not sure how much. It's probably easy enough that I'll just do it though.