Enabler: Content System / REST API "CRM-Items" live sync

[afandian]

Owner

@ppolischuk1

Description

'CRM-items' is a catch-all for data that falls out-of-band with regard to UNIXML, as expressed in the UNIXSD format. It is mostly non-bibilographic administrative metadata, but also includes references. It is used to populate the REST API from Content System, which causes a wide array of data bugs. This Epic is to replace that mechanism so all of this data is up to date.

• For /v1/works REST API users
• Who want to get up to date cited-by counts, journal names, relationships and other items contained in the <crm-items> section of UNIXSD
• The Content System Liev Sync
• Is a set of data replication pipelines, triggers
• That update the REST API with any state changes within Content System, implemented in Manifold
• Unlike <crm-items> in UNIXSD
• This solution will ensure that whenever data changes in the journals, member-info, cited-by, relationships or other tables, it is reflected in our /v1/works REST API

Relevant data includes:

• New Member IDs
• Member name changes
• Owner Prefix publisher name changes
• Journal Cite ID / DOI changes
• Book Cite ID / DOI changes
• Owner prefix / content DOI assignment
• Possibly cited-by-counts

Business Outcomes

• We can build APIs against Manifold that once had to be built against Content System
• Changes to member information are updated without manual intervention, and kept up-to-date on an ongoing basis

Leading Indicators

• TODO

Nonfunctional Requirements

• TODO

Related Features

• Content System pushes member-type information whenever they change.
  • (e.g. 'publisher-name', 'member-id', 'owner-prefix' )
• Content System pushes "journal structure" information whenever they change.
  • (e.g. 'citation-id', 'journal-id')
• Manifold can send automatic updates to Cayenne
• Cayenne can retrieve non-bibliograhpic metadata during a cold re-index
• Cayenne no longer gets non-bibiligraphic metadata from ingest crm-items.