MatthewChatham / glassdoor-review-scraper

Scrape reviews from Glassdoor
BSD 2-Clause "Simplified" License
180 stars 252 forks source link

Credentials now can be added through command line #10

Open morkapronczay opened 5 years ago

morkapronczay commented 5 years ago

A little quick fix: if the credentials were supplied through command line error was thrown as there was no secret.json to find. Now it is fixed.

btw thank you, for this scraper, I just used it teach on a text mining course!

avfc1982 commented 2 years ago

Hi,

I get the following error

raise Exception(msg) Exception: Please provide Glassdoor credentials. Credentials can be provided as a secret.json file in the working directory, or passed at the command line using the --username and --password flags.

when trying to run the following command ( the username and password is not real but the ones I have entered on glassdoor signs in successfully)

python main.py --headless --username johndoe69@yahoo.com --password 1lovejd1970@jd --url "https://www.glassdoor.com/Overview/Working-at-Wells-Fargo-EI_IE8876.11,22.htm" --limit 1000 -f wells_fargo_reviews.csv

Thanks