search

RipMeApp / ripme

Downloads albums in bulk
MIT License
3.68k stars 625 forks source link

RipMe stops downloading after 24 images on xhamster on any gallery #1803

Open neuralstamp opened 3 years ago

neuralstamp commented 3 years ago

Expect to download the full contents of the gallery

Actual Behavior

RipMe stops downloading after 24 images on xhamster on any gallery

morzik45 commented 3 years ago

The same problem, as I understand it, only downloads the first page of the mobile version of the site. This helps

Downloading a URL range

after the link you add /{1-X} Where X = gallery size / 24 rounded up eg: for gallery with 250 images need add /{1-11}

One problem remains, 11 folders with 24 photos in each

parth-collab commented 3 years ago

Any updates on this?

ghost commented 3 years ago

Seems like the ripper is relying on CSS or Javascript to respond to the "data-page=next" command...except that doesn't exist on the mobile version of the site, the server generates static links.

If I can figure out the jsoup API and remember my HTML...it seems like it just needs to look for a different element to determine next page. That's somewhat easy as the next-page button has it's own class:

<a class="prev-next-list-link prev-next-list-link--next" href="blah" rel="next">Next page</a>

When there is no next page, this particular class disappears entirely.

Changing a[data-page=next] to prev-next-list-link prev-next-list-link--next might work....but I really don't know jsoup or Java all that well.

soloturn commented 3 years ago

duplicate of #1777 #1824