The initial scraper run should parse all documentation-relevant links from "overview pages" like this one and pass them to other methods which then scrape the data.
An example for an "overview page" can be found here:
http://en.cppreference.com/w/c
Note that although we can use the same scraper for both C and C++ from this page, we should obviously differentiate between data from the languages and put them into different directories.
The initial scraper run should parse all documentation-relevant links from "overview pages" like this one and pass them to other methods which then scrape the data. An example for an "overview page" can be found here: http://en.cppreference.com/w/c Note that although we can use the same scraper for both C and C++ from this page, we should obviously differentiate between data from the languages and put them into different directories.