sul-dlss / libsys-airflow

Airflow DAGS for migrating and managing ILS data into FOLIO along with other LibSys workflows
Apache License 2.0
5 stars 0 forks source link

VMA - ability for user to create preprocessing scripts #1090

Open ahafele opened 4 months ago

ahafele commented 4 months ago

Libsys discussion needed - In Symphony/Eloader land we had a large number of preprocessing perl scripts that would run on MARC records before loading. We have accounted for some of this need in the interface configuration options, but we still have a need to automate some custom MARC modification before loading and would like to enable a small number of users to create and manage the scripts to do so. Currently there are many "packages" that are not fully automated through VMA because the records are first downloaded from VMA by user, edited in e.g. MARCedit, and then loaded to Data Import.

Examples:

ahafele commented 2 months ago

We should explore if any of these needs could be met with interface configuration options.