cedadev / archive-opensearch

Prototype Opensearch Application for the CEDA Archive
0 stars 0 forks source link

Look into dc:date #105

Closed rsmith013 closed 3 years ago

rsmith013 commented 3 years ago

http://opensearch-test.ceda.ac.uk/opensearch/request?httpAccept=application/atom%2Bxml&parentIdentifier=a6efcb0868664248b9cb212aba44313d&uuid=afcbb5fe4a6029742920e6d449f574e11b5f911f

rsmith013 commented 3 years ago

Single dates are permitted and have found a bug in the scanner which meant that many dates and geo-spatial information was being missed. Have corrected this now and re-scanning. Need to check before closing.


GET opensearch-files/_search
{
  "query": {
    "bool": {
      "must_not": [

      ],
      "must": [
                {
          "exists": {
            "field": "info.temporal"
          }
        }]
    }
  },
  "size": 1,
  "aggs": {
    "dir": {
      "terms": {
        "field": "projects.opensearch.datasetId.keyword",
        "size": 100
      }
    }
  }
}
rsmith013 commented 3 years ago

investigated all main datasets with missing dates. Have corrected the code in some places and added some cleaner functions to make it more flexible. Some issues are to do with file metadata and we can push back to data producers.