RipMeApp / ripme

Downloads albums in bulk
MIT License
3.7k stars 630 forks source link

Twitter Ripper not getting all media #1335

Open masteraaran opened 5 years ago

masteraaran commented 5 years ago

Expected Behavior

The ripper should rip every image or video ONLY from the twitter user's own media.

Actual Behavior

The ripper seems to be doing the following:

What it chooses to download and not download seems to be completely random. It does not seem to be restricting itself to the 'media' section, but instead the whole account. It will completely skip posts from the past day or so, then download an image set, then skip another post or two, etc...

charzho commented 5 years ago

There is a setting to ignore retweets and replies.

However, I have tested with both setting on and off, and the ripper definitely missed tweets contained in twitter threads.

It misses all posts except the parent post in these threads. Example: https://twitter.com/RoxyRexArt/status/1131775469563666432

The ripper also does not rip past a certain point, even if they're available in the "Media" tab.

masteraaran commented 5 years ago

There is a setting to ignore retweets and replies.

However, I have tested with both setting on and off, and the ripper definitely missed tweets contained in twitter threads.

It misses all posts except the parent post in these threads. Example: https://twitter.com/RoxyRexArt/status/1131775469563666432

The ripper also does not rip past a certain point, even if they're available in the "Media" tab.

Righto. I have that option turned off, specifically to make sure that it wasn't causing a problem. I assumed that using the 'media' tab as the rip URL would mostly restrict the results to the content posted by the user.

In any case, it is definitely missing posts that it should be getting, as you have also found. Glad I'm not alone ;)