Google Maps Web Scrapper For Comments

[HarunSMetin]

Issue Summary: This task involves developing a web scraper to extract comments and reviews from Google Maps. The scraper will gather valuable feedback and insights from users to improve our understanding of location-based experiences.

Key Objectives:

• Scraping Mechanism: Develop a robust web scraping mechanism to extract comments and reviews from Google Maps.
• Data Extraction: Extract relevant information such as user comments, ratings, timestamps, and locations from Google Maps pages.
• Data Parsing: Parse the extracted data into structured formats for further analysis and storage.
• Scalability: Design the scraper to handle a large volume of requests efficiently, considering potential scalability needs.

Tasks:

• Research Google Maps page structure and review mechanisms.
• Choose appropriate web scraping tools or libraries for the task.
• Develop scripts to crawl Google Maps pages and extract comment data.
• Test the scraper on various locations and scenarios to ensure reliability.
• Implement error detection and handling mechanisms.
• Parse the extracted data into a structured format (e.g., JSON, CSV).

[HarunSMetin]

scrapper.py

Now it can able to get comments and store them in a file It will be connected with backend via http requests