search

pevers / images-scraper

Simple and fast scraper for Google
ISC License
229 stars 71 forks source link

Is there a way to prevent the Google image scraper from scrolling down and loading tons of images? #19

Closed ghubcompressedtime closed 5 years ago

ghubcompressedtime commented 7 years ago

It takes a long time and I only want to load the first ten or so images in any case.

Thank you.

pevers commented 7 years ago

Hi @ghubcompressedtime,

It is possible, I would however change the code by removing the Nightmare headless browser and switch to a simple Request call that fetches the first page of Google images. That is beyond this project but I can try to come up with an early opt-out option that stops scrolling as soon as it hits x results.

ramazan793 commented 7 years ago

Hi, @pevers! So, you did it?

pevers commented 5 years ago

I have finally fixed this.