Friendly Scraper
Friendly Scraper is a tool that I want for the market research part of my job. Scraping websites can be fun and interesting when the details about the target webpage can be presented in easy to view format. Python, Java, Javascript or whatever the programming language the scraper works, our requirement is to get complete webpage and then decide which parts of the page I want. Some pain points that I faced when scraping the interweb are,
- How to find which part of the webpage has the information?
- How to see the pattern if many pages are there?
- What is there are many types of pages
- If there are dynamic content created by the web server, how to query that?
Friendly scraper tries to answer some of the challenges above by first providing the parts of webpages in categories, which gives you the overview on how to proceed next. And then the fun starts.
- Provide the link of the webpage
- Show the number of Links of Images, Videos and other pages, Lists, Headings, Paragraphs, and Tables in that page are shown.
- If requested then some number of the above parts of the websites are populated
Here is some live examples
Here is another from Ycombinator
Following features to be implemented Refer the issues...
Have a great time getting the information from the Interwebs.