bbcarchdev / twine

An RDF workflow engine
https://bbcarchdev.github.io/twine/
Apache License 2.0
8 stars 2 forks source link

Add support for multiple processor instances with different configuration options within a workflow #34

Open nevali opened 6 years ago

nevali commented 6 years ago

e.g.,

workflow=sparql-get:source,sparql-put,s3-put:mybucket

[s3-put:mybucket] ;; specific options for this processor being invoked with the "mybucket" instance name

Specifying a name which lacks a configuration section would be an error.

This could be achieved through a simple API in libtwine that modules call during initialisation to scan the config for instances of themselves and register them as processors

Tracked as RESDATA-1289