Open bartels50642 opened 4 years ago
https://github.com/sachinchaturvedi93/glassdoor-review-scraper
Try this out, I haven't updated this in a while though. Let me know if I could help.
Hi Sachin,
Thanks for the speedy reply! I tried your code and it looks like part of it is working (Chrome opens, goes to Glassdoor, passes through login, and opens the "Premise Data Corporation" landing page) but I still get an error in python like this:
NoSuchElementException: Message: no such element: Unable to locate element: {"method":"css selector","selector":".paginationPaginationStylepage.paginationPaginationStylecurrent"} (Session info: chrome=86.0.4240.111)
Any ideas what could be wrong?
I guess the element isn't loading. Try again or try adding wait time. I'm sure that's the name of the current page class. I checked the source code too.
Hrm okay, how would I go about adding wait time? Sorry I am new to scraping...
Should I change the "time.sleep(1)" to "time.sleep(500)" (or some other number that is greater?
@bartels50642 Did you ever figure it out? I am having the same issue with the page-turner.
Hi All,
I'm trying to run this code as of Oct 2020, but I keep running into the "No Such Element Exception" error. Any help here would be GREATLY appreciated! Here is the error that runs:
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,040 INFO 3 :(21411) - Scraping up to 25 reviews.
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
2020-10-26 16:52:48,096 INFO 2 :(21411) - Signing in to bartels.k@northeastern.edu
NoSuchElementException Traceback (most recent call last)