MatthewChatham / glassdoor-review-scraper

Scrape reviews from Glassdoor
BSD 2-Clause "Simplified" License
172 stars 251 forks source link

Does not recognize URL as an argument #60

Open Shivani-Srivastava opened 2 years ago

Shivani-Srivastava commented 2 years ago

When I run the following command from the terminal on my Ubuntu 21.10 machine, it gives me the following error.

python3 main.py --headless --start_from_url "https://www.glassdoor.co.in/Reviews/insert-company-name" --limit 1000 -f glassdoor_reviews.csv

main.py: error: unrecognized arguments: https://www.glassdoor.co.in/Reviews/company-name

Is it possible that this is so because it's the Indian site?

The Wells-Fargo example command also gives me the following error

Traceback (most recent call last): File "/home/shivani/ISB/glassdoor-review-scraper-master/main.py", line 89, in d = json.loads(f.read()) File "/usr/lib/python3.9/json/init.py", line 346, in loads return _default_decoder.decode(s) File "/usr/lib/python3.9/json/decoder.py", line 340, in decode raise JSONDecodeError("Extra data", s, end) json.decoder.JSONDecodeError: Extra data: line 1 column 11 (char 10)

I've tried editing the main.py file for this particular error but not sure what's wrong. Open to solutions!

Any leads?