search

alex9311 / information-retrieval

TU Delft, Masters Software Technology, Information Retrieval, 3rd Quarter 2015
1 stars 2 forks source link

Added the web crawler #52

Closed GizKockesen closed 9 years ago

GizKockesen commented 9 years ago

The web crawler retrieves descriptions of the gathered apps in the app store. It also gathers all kinds of other info but we can easily get rid of those. Make sure you read the readme file and set the operation type in the code to "store" if you want to retrieve apps. This folder has the csv files that got created from retrieving apps and their info from when I started the crawler and if you run it on your system, it will write over those files. If you want to keep them, then just copy all the files to another folder and delete all of the csv files. Then the crawler will create new csv files with the apps that you retrieve.

alex9311 commented 9 years ago

this looks awesome!! Should I merge it in?

GizKockesen commented 9 years ago

Yeah :) On 21 Mar 2015 20:48, "Alex Simes" notifications@github.com wrote:

this looks awesome!! Should I merge it in?

— Reply to this email directly or view it on GitHub https://github.com/alex9311/TUD-Information-Retrieval-Group-02/pull/52#issuecomment-84444767 .