search

tzuhsial / InstagramCrawler

A non API python program to crawl public photos, posts or followers
https://github.com/iammrhelo/InstagramCrawler
MIT License
378 stars 105 forks source link

Followers crawling #29

Open InesArous opened 6 years ago

InesArous commented 6 years ago

Hi guys, I was able to crawl followers on Instagram after modifying some lines in the intagramcrawler.py. Now, I am facing a problem when the number of followers is over 1000: The crawler scrolls down the followers page but the page freezes in a loading phase so after some time the crawler simply quits the query. Have you faced this issue before? If so how to fix it?

AbeerArora123 commented 6 years ago

Could I ask what you altered in the code to get it working?

markusMM commented 5 years ago

Do you mean, you can crawl for followers as constraint? Actually, if this script would allow pure SQL or Hadoop, it would be much more useful.

e.g. -q "select top 100000 from instagram.photos order by num_follows instargram.follower"

Or something like that.

Anyways maybe that's not how a crawler works, but it would be very cool B-)