Query malfunction

[dr0i]

http://lobid.org/resource?id=urn:nbn:de:101:1-201210094953 yields nothing. Using the index lobid-resources-20141007-061557 it works.

• the index-config of both index' are the same (regarding to urn)
• data is there

Investigating.

[dr0i]

Oh - not good: the link http://lobid.org/resource?id=urn:nbn:de:101:1-201210094953 (using our productive index lobid-resources-20141008-112026 ) now DOES yield a result - But nothing was changed !

(Using the newer index lobid-resources-20141015-094925 will correctly yield nothing because the resource no longer exist - see http://193.30.112.134/F/?func=find-c&ccl_term=idn%3DHT017502667. )

However, this seems erratic to me, or missed I something?

[dr0i]

From the logs:

Not cached: {ID=urn:nbn:de:101:1-201210094953}.LOBID_RESOURCES....50.0.., will cache for one hour
2014-10-16 09:29:59,214 - [DEBUG] - from application in play-akka.actor.default-dispatcher-11312
Using query: {
  "bool" : {
    "must" : {
      "multi_match" : {
        "query" : "urn:nbn:de:101:1-201210094953",
        "fields" : [ "@graph.@id", "@graph.http://purl.org/lobid/lv#hbzID.@value", "@graph.http://purl.org/lobid/lv#zdbID.@value", "@graph.http://purl.org/ontology/bibo/isbn13.@value", "@graph.http://purl.org/ontology/bibo/isbn.@value", "@graph.http://purl.org/ontology/bibo/issn.@value", "@graph.http://purl.org/lobid/lv#urn.@value" ],
        "operator" : "AND"
      }
    }
  }
}

2014-10-16 09:29:59,444 - [DEBUG] - from application in play-akka.actor.default-dispatcher-11312
Got response: {
  "took" : 230,
  "timed_out" : false,
  "_shards" : {
    "total" : 5,
    "successful" : 5,
    "failed" : 0
  },
  "hits" : {
    "total" : 0,
    "max_score" : null,
    "hits" : [ ]
  }
}

And, later:

Not cached: {ID=urn:nbn:de:101:1-201210094953}.LOBID_RESOURCES....50.0.., will cache for one hour

2014-10-16 10:30:10,312 - [DEBUG] - from application in play-akka.actor.default-dispatcher-11419
Using query: {
  "bool" : {
    "must" : {
      "multi_match" : {
        "query" : "urn:nbn:de:101:1-201210094953",
        "fields" : [ "@graph.@id", "@graph.http://purl.org/lobid/lv#hbzID.@value", "@graph.http://purl.org/lobid/lv#zdbID.@value", "@graph.http://purl.org/ontology/bibo/isbn13.@value", "@graph.http://purl.org/ontology/bibo/isbn.@value", "@graph.http://purl.org/ontology/bibo
/issn.@value", "@graph.http://purl.org/lobid/lv#urn.@value" ],
        "operator" : "AND"
      }
    }
  }
}

2014-10-16 10:30:10,571 - [DEBUG] - from application in play-akka.actor.default-dispatcher-11419
Got response: {
  "took" : 258,
  "timed_out" : false,
  "_shards" : {
    "total" : 5,
    "successful" : 5,
    "failed" : 0
  },
  "hits" : {
    "total" : 1,
    "max_score" : 8.8345375,
    "hits" : [ {
      "_index" : "lobid-resources-20141008-112026",
      "_type" : "json-ld-lobid",
      "_id" : "http://lobid.org/resource/HT017502667",
      "_score" : 8.8345375,
      "_source":{"@graph":[{"http:\/\/d-nb.info\/standards\/elementset\/gnd#preferredNameForThePerson":[{"@value":"Dresel, Stephan"}],"http:\/\/d-nb.info\/standards\/elementset\/gnd#preferredName":[{"@value":"Dresel, Stephan"}],"@id":"http:\/\/d-nb.info\/gnd\/12431192X","ht
tp:\/\/d-nb.info\/standards\/elementset\/gnd#preferredNameEntityForThePerson":[{"@id":"_:t1"}]},{"@id":"http:\/\/dewey.info\/class\/330\/","http:\/\/www.w3.org\/2004\/02\/skos\/core#prefLabel":[{"@value":"Wirtschaft","@language":"de"},{"@value":"Economics","@language":"en"}
]},{"http:\/\/umbel.org\/umbel#isLike":[{"@id":"http:\/\/nbn-resolving.de\/urn:nbn:de:101:1-201210094953"}],"http:\/\/purl.org\/dc\/elements\/1.1\/publisher":[{"@value":"Stiftung WHU"}],"http:\/\/purl.org\/dc\/terms\/language":[{"@id":"http:\/\/id.loc.gov\/vocabulary\/iso63
9-2\/eng"}],"http:\/\/purl.org\/dc\/terms\/medium":[{"@id":"http:\/\/rdvocab.info\/termList\/RDACarrierType\/1010"},{"@id":"http:\/\/rdvocab.info\/termList\/RDACarrierType\/1018"}],"http:\/\/www.w3.org\/2002\/07\/owl#sameAs":[{"@id":"http:\/\/hub.culturegraph.org\/resource\
/HBZ-HT017502667"}],"@type":["http:\/\/purl.org\/dc\/terms\/BibliographicResource","http:\/\/data.archiveshub.ac.uk\/def\/ArchivalResource","http:\/\/purl.org\/vocab\/frbr\/core#
Manifestation","http:\/\/purl.org\/ontology\/bibo\/Book","http:\/\/purl.org\/ontology\/bibo\/Thesis"],"http:\/\/purl.org\/dc\/terms\/issued":[{"@value":"2012"}],"http:\/\/purl.org\/lobid\/lv#urn":[{"@value":"urn:nbn:de:101:1-201210094953"}],"http:\/\/purl.org\/dc\/terms\/contributor":[{"@id":"http:\/\/d-nb.info\/gnd\/12431192X"}],"http:\/\/purl.org\/vocab\/frbr\/core#exemplar":[{"@id":"http:\/\/lobid.org\/item\/HT017502667:DE-929:"}],"http:\/\/purl.org\/dc\/terms\/subject":[{"@id":"http:\/\/dewey.info\/class\/330\/"},{"@id":"http:\/\/purl.org\/lobid\/rpb#n540100"}],"http:\/\/purl.org\/dc\/terms\/title":[{"@value":"Offshoring of support functions"}],"http:\/\/rdvocab.info\/Elements\/placeOfPublication":[{"@value":"Vallendar"}],"http:\/\/xmlns.com\/foaf\/0.1\/isPrimaryTopicOf":[{"@id":"http:\/\/193.30.112.134\/F\/?func=find-c&ccl_term=IDN%3DHT017502667"}],"http:\/\/purl.org\/dc\/terms\/isPartOf":[{"@id":"http:\/\/lobid.org\/resource\/Edoweb"},{"@id":"http:\/\/lobid.org\/resource\/RPB"}],"@id":"http:\/\/lobid.org\/resource\/HT017502667","http:\/\/rdvocab.info\/Elements\/statementOfResponsibility":[{"@value":"Stephan Dresel. WHU - Otto Beisheim School of Management. Betreuer: Thomas Hutzschenreuter ; Stephan M. Wagner"}],"http:\/\/rdvocab.info\/Elements\/publicationStatement":[{"@value":"Vallendar; Stiftung WHU; 2012"}],"http:\/\/www.w3.org\/2007\/05\/powder-s#describedby":[{"@id":"http:\/\/lobid.org\/resource\/HT017502667\/about"}],"http:\/\/purl.org\/lobid\/lv#hbzID":[{"@value":"HT017502667"}]}],"internal_id":"http:\/\/lobid.org\/resource\/HT017502667"}
    } ]
  }
}

[fsteeg]

We should reproduce this issue with the latest index since the old index could have been corrupted by our recent partial ES outage. Just discussed this in person with @dr0i, reassigning.

[dr0i]

fyi - using curl:

curl -XGET 'http://193.30.112.172:9200/lobid-resources/_search' -d'
{
query: {
  "bool" : {
    "must" : {
      "multi_match" : {
        "query" : "urn:nbn:de:101:1-201210094953",
        "fields" : [ "@graph.@id", "@graph.http://purl.org/lobid/lv#hbzID.@value", "@graph.http://purl.org/lobid/lv#zdbID.@value", "@graph.http://purl.org/ontology    /bibo/isbn13.@value", "@graph.http://purl.org/ontology/bibo/isbn.@value", "@graph.http://purl.org/ontology/bibo/issn.@value", "@graph.http://purl.org/lobid/lv#urn.@value" ],
        "operator" : "AND"
      }
    }
  }
}
}'

=> every second query yields nothing. Looks like our "old cluster problem" again.

[dr0i]

In comparison, querying the new index, which was build after the cluster has splitted:

curl -XGET 'http://193.30.112.172:9200/lobid-resources-staging/_search' -d'
{
query: {
  "bool" : {
    "must" : {
      "multi_match" : {
        "query" : "urn:nbn:de:hbz:5n-21234",
        "fields" : [ "@graph.@id", "@graph.http://purl.org/lobid/lv#hbzID.@value", "@graph.http://purl.org/lobid/lv#zdbID.@value", "@graph.http://purl.org/ontology/bibo/isbn13.@value", "@graph.http://purl.org/ontology/bibo/isbn.@value", "@graph.http://purl.org/ontology/bibo/issn.@value", "@graph.http://purl.org/lobid/lv#urn.@value" ],
        "operator" : "AND"
      }
    }
  }
}
}'

every querying works! Note that the original urn urn:nbn:de:hbz:5N-21234 don't work because the index config uses id_analyzer which forces the to be indexed URN to be lowercase. Will make a new issue for this.

[dr0i]

Problem solved by switching to the new index. Closing.