fair-research / bdbag

Big Data Bag Utilities
https://fair-research.org
Apache License 2.0
49 stars 23 forks source link

Support external fetch transports via plug-in architecture. #37

Closed mikedarcy closed 3 years ago

mikedarcy commented 4 years ago

The current set of fetch transports is basically hard-wired into the code, whereby the only way to add to (or override) the default set of handlers is to modify the bdbag.fetch.transports module source code directly. This has proven to be too limiting in practice.

Refactoring the bdbag.fetch.transports module so that it supports run-time loading of externally provided fetch transport providers (similar to how the bdbag.fetch.resolvers module works) should be sufficient address this.

mikedarcy commented 3 years ago

Support for this has been implemented, merged to master, and will be released in the upcoming 1.6.0 release.