Closed saggu closed 6 years ago
This is after I deleted all the documents with tld = cfr.org
from es manually? how is _db.json, have u changed it manually before?
Yes, from ES manually. Havent touched _db.json today. Curious as to how does that query work? TO get the KG to show on mydig?
Basically, myDIG gets kg
and kg original
from es directly and full join them with the tlds which appear in catalog. kg original
is restricted by term created_by: etk
.
What is happening here ^ ?
can u try above query in kibana
Result of
{
"query": {
"term": {
"knowledge_graph.website.key": {
"value": "cfr.org"
}
}
}
}
is 1222
and result of
POST sage_kg/_search
{
"aggs": {
"group_by_tld_original": {
"filter": {
"bool": {
"must_not": {
"term": {
"created_by": "etk"
}
}
}
},
"aggs": {
"grouped": {
"terms": {
"field": "tld.raw",
"size": 2147483647
}
}
}
},
"group_by_tld": {
"terms": {
"field": "tld.raw",
"size": 2147483647
}
}
},
"size":0
}
has that number to be 5872.
Looks wrong
myDIG's query is based on TLD in CDR, ur term query is based on website
in kg.
btw, in latest mydig, delete by tld is also based on tld.raw
, knowledge_graph.website
is not sufficient in some cases (e.g., if no website is extracted).
@saggu close it? what about #190
Yeah, I guess. Closing this