[Generic Scraper] Add more fields to GenericScraper.java

[daminisatya]

When compared to Diffbot, which scrapes only the basic information from a given URL, the current API is able to provide the following details.

• Language
• Links
• images
• title
• source files
• Text in the link tags

Further enhancements would be better if it is able to scrape most deeply parsed data. I want suggestions on this. These are one's from my side.

• [ ] Video links
• [ ] Social media links
• [ ] Content of the meta tags
• [ ] inline scripts
• [ ] page URL

Along with some other generic fields we can have options(as shown below) where specific data can be retrieved accordingly.

• Article API (Extracts all details about the articles and other blog posts)
• Product API (Extracts all details about the product from a given E commerce website)
• Image API (Extracts all the images and their attributes)
• DiscussionAPI (Extracts all the discussion threads, comments and likes)

The above APIs are the services currently being offered by Diffbot. The links are to their docs and sample JSON objects which they have implemented.

[daminisatya]

@mariobehling @Orbiter any more suggestions?

[sudheesh001]

Implemented with boilerpipe library for NLP