search

thedatahub / Datahub-Factory

Datahub::Factory - Transport metadata between Collection Management Systems and the Datahub
Other
2 stars 4 forks source link

Add metrics to time how long it takes for a single record or a batch to be transported #38

Open netsensei opened 7 years ago

netsensei commented 7 years ago

Title says is it all. We want to time how long it takes for a batch of records to be processed. This is for debugging purposes.

A single function change can mean a difference of 100ms in the processing of a single record. But that does scale to 16 minutes of extra processing when 10.000 records are queued.