Ingestion OAI-PMH logs into ELK

[cessda-bitbucket-importer]

Original report on BitBucket by Joshua Tetteh Ocansey (GitHub: Joshocan).

---

CESSDA Logging guideline can serve as a guide

Keys Points

• Structure logging format as JSON
• The default logging level is WARNING
• Parameterize and contextualize logs for easier analysis ( Example are seen in the guideline above)

‌

What to log:

• Number of oai-pmh records harvested per second
• Errors/exceptions generated during harvesting
• Duration in seconds for harvesting metadata
• Other systems exceptions generated per second

‌

[cessda-bitbucket-importer]

Original comment by John Shepherdson (GitHub: john-shepherdson).

---

@matthew-morris-cessda has this been resolved?

[cessda-bitbucket-importer]

Original comment by Matthew Morris (GitHub: matthew-morris-cessda).

---

The logs have been added to the repository handler.

[cessda-bitbucket-importer]

Original comment by John Shepherdson (GitHub: john-shepherdson).

---

Included in release