Report module - Githubissues

thedatahub / Datahub-Factory

Datahub::Factory - Transport metadata between Collection Management Systems and the Datahub

Other

2 stars 4 forks source link

Report module #20

Open pieterdp opened 7 years ago

pieterdp commented 7 years ago

Currently, Datahub::Factory spews all its errors to STDERR/STDOUT. We would like to generate a log file (per run) where on every line we get the following information for every failed record:

identifier
error message
action (e.g. import failed, or conversion failed, or conversion failed, import succeeded)

This report/log file must be sent by e-mail to a configurable maintainer, but it must also be possible to switch off emailing alltogether.

pieterdp commented 7 years ago

See f59fab08bb3028d6a4c3f29b554ea33a34423965: added support for configurable log levels and output.

netsensei commented 7 years ago

Todo

Improve logging to a log file
Log should be able to mail a digest once the entire process has been completed
Log should be able to log to a database (mongo,...) for monitoring purposes.
Log data to elastic for Kibana support (https://www.elastic.co/products/kibana) (optional)