search

RipMeApp / ripme

Downloads albums in bulk
MIT License
3.71k stars 630 forks source link

Not all pictures are downloaded on DevianArt.com #429

Open BilimMcG opened 6 years ago

BilimMcG commented 6 years ago

Expected Behavior

I enter the URL: https://shilin.deviantart.com/gallery/

Actual Behavior

.. but from 530 pictures of the user Shilin it is downloaded only 263 pictures. Why?

rautamiekka commented 6 years ago

You need to use either https://shilin.deviantart.com/gallery/?catpath=/ or https://shilin.deviantart.com (which auto-translates into the former in RipMe) to get everything; https://shilin.deviantart.com/gallery/ gets only the 'Featured' section.

BilimMcG commented 6 years ago

Tried it. Downloaded 263 pictures (

Hrxn commented 6 years ago

You are really sure that there are actually 530 pictures?

rautamiekka commented 6 years ago

Hmm, true, he doesn't have 530 pics. Instead he has 215 journal posts and 21 scrap uploads, which together leave 294 posts/uploads of other types, which should mean the actual gallery.

I'll DL it all to see for myself; I did it earlier to check the output for errors (none) and deleted it then.

rautamiekka commented 6 years ago

315 downloads, of which 1 is a ZIP.

BilimMcG commented 6 years ago

How did you get 315 pictures to download?

I've been looking for a good downloader of images from DevianArt.com. At the moment I think that RipMe is the best of them. I would be very grateful if you would strong support resource of DevianArt.com.

rautamiekka commented 6 years ago

Try this: 1) Rename the deviantart_shilin folder into something else. 2) Set Log level to Debug. 3) Enable Save logs. 4) Use 1 download thread. 5) Use 5000-millisecond timeout. 6) Disable Save URLs only. 7) Disable Remember URL history. 8) Download.

If you get a different result than 315 downloads, post the log.txt somewhere like Pastebin that should be in the folder.

BilimMcG commented 6 years ago

Result less than 315. https://pastebin.com/5J8xDQhM

rautamiekka commented 6 years ago

^ You have a pretty serious connectivity issue.

cyian-1756 commented 6 years ago

@BilimMcG

Can you please retest this with ripme 1.7.52?

BilimMcG commented 6 years ago

Hi! In log: Failed to load https://www.deviantart.com/shilin/gallery/ after 1 attempts

Ripme version: v1.7.61

cyian-1756 commented 6 years ago

Can you try again? That error looks like it was caused by a network issue

BilimMcG commented 6 years ago

Not working. At home and in the office. Different Internet providers. log.txt