search

DataONEorg / metrics-service

An efficient database and REST API for delivering aggregated data set metrics to clients.
Apache License 2.0
2 stars 1 forks source link

Test Portal ES Query performance #60

Open rushirajnenuji opened 5 years ago

rushirajnenuji commented 5 years ago

Test Portal ES Query performance

rushirajnenuji commented 5 years ago

Performance Testing - Iteration 1:

  1. portal-test

    CollectionQuery: (((northBoundCoord:5) AND (northBoundCoord:5) AND (text:*ocean*)) AND (-obsoletedBy:* AND formatType:METADATA))
UpdatedCollectionQuery: (((northBoundCoord:5) AND (northBoundCoord:5) AND (text:*ocean*)) AND (formatType:METADATA))
    • non-obsoleted PID count: 134
    • total PID count: 232

  2. laurentest4

    CollectionQuery: (((text:*soil*) AND ((keywords:\"*soil layer*\") AND (attribute:\"*soil layer*\")) AND ((dateUploaded:[1800-01-01T00:00:00Z TO 2009-12-31T23:59:59Z]) AND (beginDate:[1800-01-01T00:00:00Z TO 2009-12-31T23:59:59Z])) AND (isPublic:true) AND (numberReplicas:[1 TO *])) AND (-obsoletedBy:* AND formatType:METADATA))
UpdatedCollectionQuery: (((text:*soil*) AND ((dateUploaded:[1800-01-01T00:00:00Z TO 2019-12-31T23:59:59Z]) AND (beginDate:[1800-01-01T00:00:00Z TO 2019-12-31T23:59:59Z])) AND (isPublic:true) AND (numberReplicas:[1 TO *])) AND (-obsoletedBy:* AND formatType:METADATA))
    • non-obsoleted PID count: 270
    • total PID count: 728
    • datasetIdentifierFamily Count: 10343

  3. ortals3

    CollectionQuery:(((text:*climate*)) AND (-obsoletedBy:* AND formatType:METADATA))
UpdatedCollectionQuery: (((text:*climate*)) AND (formatType:METADATA))
    • non-obsoleted PID count: 6030
    • total PID count: 7970
    • datasetIdentifierFamily Count: 49011
# Collection Query PID Size Collection Query Time Query Resolve Time Portal DIF Time ES Aggregatio Time
1 232 179 ms 676 ms 068 ms 1503 ms
2 728 24 ms 639 ms 398 ms 1208 ms
3 7970 24 ms 618 ms 3752 ms 4753 ms