search

Xealeph / Yiff.party-Image-Scraper

A simple Image Scraper for yiff.party profiles.
MIT License
10 stars 4 forks source link

Missing image from scraping #24

Open Shin898 opened 3 years ago

Shin898 commented 3 years ago

Sometimes images present on page are not downloaded by your script. If I try to scrape this profile (https://yiff.party/patreon/3221105) the image at this link (https://data.yiff.party/patreon_inline/15766578/f8a6acddcc7c6e06e63ca590ff46e90d5ff57e1c.jpg) is not downloaded. I notice same thing on other profile in particular when there are more than one image in gallery and not as attachment. I know a bit of python and try to fix your code but I'm not be able to do it. However I recognise that missing image link is present in "containersPart2" but for some reason when you do container.find_all('a') and linkList.append(subCont['href']) that link remain excluded. Hope that these information can help you. Sorry for my bad english and thanks in advance for your time and help

Xealeph commented 3 years ago

Sure, I'll look into it.

Shin898 commented 3 years ago

Any news?

Xealeph commented 3 years ago

Barely, since I'm pretty busy currently. I will however try to tackle this on the weekend. Sorry for the delay.