metafacture / metafacture-core

Core package of the Metafacture tool suite for metadata processing.
https://metafacture.org
Apache License 2.0
70 stars 34 forks source link

Add original OAI-PMH opener by @dr0i #320

Closed fsteeg closed 4 years ago

fsteeg commented 4 years ago

From https://github.com/hbz/metafacture-core/blob/4.0.0-HBZ-SNAPSHOT/src/main/java/org/culturegraph/mf/stream/source/OaiPmhOpener.java

Sample flux usage:

"https://duepublico2.uni-due.de/servlets/OAIDataProvider"
|open-oaipmh(metadataPrefix="mods", dateFrom="2020-04-14")
|decode-xml
|handle-generic-xml
|encode-formeta(style="multiline")
|write("stdout");

To be used in https://gitlab.com/oersi/oersi-etl/-/issues/1, leaving as draft pull request until usage works.

fsteeg commented 4 years ago

Deployed to test:

http://test.lobid.org/fix/xtext-service/run?fix=&data=&flux="https://duepublico2.uni-due.de/servlets/OAIDataProvider"|open-oaipmh(metadataPrefix="mods",dateFrom="2020-04-16")|decode-xml|handle-generic-xml|encode-formeta(style="multiline")