search

AgiMaulana / Instagram-Comments-Scraper

Instagram comment scraper using python and selenium. Save the comments into excel.
MIT License
137 stars 44 forks source link

Alawys only get 25 comments #11

Open antoniusrc opened 2 years ago

antoniusrc commented 2 years ago

I always got this: DevTools listening on ws://127.0.0.1:1067/devtools/browser/c5dd8a90-5b53-43b0-bdc6-b9233dc94dca Found <selenium.webdriver.remote.webelement.WebElement (session="33dbdedbb8facdf838e849681b3a738b", element="1479d7a5-4e15-47ce-91dd-e45ebc5e0206")> Message: no such element: Unable to locate element: {"method":"css selector","selector":".MGdpg > button:nth-child(1)"} (Session info: chrome=94.0.4606.61)

My parameter is 5 and time 1.5, why?

antoniusrc commented 2 years ago

And what is this? '.MGdpg > button:nth-child(1)' ? because I cannot find this in Instagram source code

geoffreycrofte commented 1 year ago

I looked at the code and didn't understand how this code could even work for more than 1 day. Instagram is constantly evolving and distributes classes randomly within its DOM to avoid this kind of scrapper.

You would constantly need to upgrade the CSS selectors to make it works.

I'm doing that with a JS extension on Chrome. I'm trying to find a way that is not class-dependant. I might find a solution soon.