gosom / google-maps-scraper

scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
MIT License
852 stars 115 forks source link

How to retrieve user_reviews? #33

Open m0wer opened 7 months ago

m0wer commented 7 months ago

User reviews are always null with the default command:

touch results.csv && docker run -v $PWD/example-queries.txt:/example-queries -v $PWD/results.csv:/results.csv gosom/google-maps-scraper -depth 1 -input /example-queries -results /results.csv -exit-on-inactivity 3m

Am I doing something wrong? Is it possible to collect all user reviews of a place?

Thanks!

darealdemayo commented 7 months ago

@m0wer are you able to get the reviews per rating correctly? until a few weeks ago it worked, but now I only get 0 or every star. user_reviews also worked until a few weeks ago and now stopped working for me?

arceushui commented 6 months ago

34

If you are interested, I have raised a pull request to resolve the issue. You can just make the changes based on it.

m0wer commented 6 months ago

Currently no reviews at all @darealdemayo . Thanks for the fix @arceushui !

gosom commented 6 months ago

@arceushui thanks for the fixed.

just release version 1.1.3 with the provided fix

buscandomelavida commented 6 months ago

Hi, I tried a previous version and it worked perfectly until it stopped showing the user_reviews field. I have downloaded version 1.1.3 which I understand fixes this problem, but in all rows it still returns "null". The review_count, review_rating and reviews_per_rating fields are displayed. Does it work correctly and am I doing something wrong?

arceushui commented 6 months ago

What is the field name that you are having issue?

buscandomelavida commented 6 months ago

user_reviews field

DukeLe97 commented 6 months ago

i am having the same issue "user_reviews:null"

iamsad5566 commented 6 months ago

@DukeLe97 , @buscandomelavida I sent a PR to solve the above issue, you could take it a shot

DukeLe97 commented 5 months ago

Thanks for your contribution @iamsad5566 , is there any way to get more user_reviews? Now, it only gets 8 user_reviews per place

MartiRiusO commented 5 months ago

@iamsad5566 the PR isn't working if you change the example-queries. had you seen it?