[SHARE-993][Feature] Capture ingest errors

CenterForOpenScience / SHARE

SHARE is building a free, open, data set about research and scholarly activities across their life cycle.

http://share-research.readthedocs.io/en/latest/index.html

Apache License 2.0

100 stars 58 forks source link

[SHARE-993][Feature] Capture ingest errors #732

Closed aaxelb closed 6 years ago

aaxelb commented 6 years ago

Main things:

Custom exceptions
Removed disambiguate task
- ingest task handles transform, regulate, disambiguate
Ingester
Common ingestion pipeline -- push endpoints save as raw, use the same path as everyone else
"claiming" jobs

coveralls commented 6 years ago

Coverage increased (+0.03%) to 79.064% when pulling 0dec1e4b7a9fc7841f2fdf357c1baa3d71f56176 on aaxelb:feature/SHARE-993--capture-errors into b56e15ff526219cac813b1ce24954362eca63ca7 on CenterForOpenScience:future-release/2.15.0.