search

samvera / questioning_authority

Question your authorities
Other
54 stars 30 forks source link

when reporting performance data for linked data processing, include data sizes #246

Closed elrayle closed 4 years ago

elrayle commented 5 years ago

Description

In evaluating performance characteristics, it is useful to know the size of the data being processed in relation to the times for processing.

Proposed addition of sizes

For terms fetch...

  "performance":{
    "predicate_count":3,
    "fetch_time_s":0.398744,
    "normalization_time_s":3.0e-06,
    "fetched_size": '1234',
    "normalized_size": '321'
    "total_time_s":0.39874699999999996
  }

For search query...

  "performance":{
    "result_count":20,
    "fetch_time_s":0.717164,
    "normalization_time_s":1.737719,
    "fetched_size": '2345',
    "normalized_size": '432'
    "total_time_s":2.454883
  }

Actual

For terms fetch...

  "performance":{
    "predicate_count":3,
    "fetch_time_s":0.398744,
    "normalization_time_s":3.0e-06,
    "total_time_s":0.39874699999999996
  }

For search query...

  "performance":{
    "result_count":20,
    "fetch_time_s":0.717164,
    "normalization_time_s":1.737719,
    "total_time_s":2.454883
  }