search

VIDA-NYU / domain_discovery_tool

This repository contains the Domain Discovery Tool (DDT) project. DDT is an interactive system that helps users explore and better understand a domain (or topic) as it is represented on the Web.
http://domain-discovery-tool.readthedocs.io/en/latest/index.html
GNU General Public License v3.0
46 stars 12 forks source link

DDT stops searching after a while #22

Closed kienpt closed 7 years ago

kienpt commented 7 years ago

So I built the model, started a crawl then searched for few queries again using both Google and Bing APIs. DDT did not return any results after these. Following is the log. I think when I entered the query, there were other logs but I was not able to copy since DDT keeps printing new logs.

127.0.0.1 - - [23/May/2017:20:45:44] "POST /getStatus HTTP/1.1" 200 2 "http://localhost:8084/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36"

Status {}

127.0.0.1 - - [23/May/2017:20:45:44] "POST /getStatus HTTP/1.1" 200 2 "http://localhost:8084/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36"

Status {}

127.0.0.1 - - [23/May/2017:20:45:45] "POST /getStatus HTTP/1.1" 200 2 "http://localhost:8084/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36"

Status {}

127.0.0.1 - - [23/May/2017:20:45:45] "POST /getStatus HTTP/1.1" 200 2 "http://localhost:8084/" "Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/57.0.2987.133 Safari/537.36"

Status {}

yamsgithub commented 7 years ago

This was probably when we had Goog and Bing quota issues. I tested this scenario and do not see a problem.