search

ukwa / ukwa-pywb

GNU General Public License v3.0
11 stars 3 forks source link

Allow alternative paths/prefixes for WebHDFS stores #102

Closed anjackson closed 9 months ago

anjackson commented 1 year ago

The current PywB loader for WebHDFS hard-codes the webhdfs path. It would be neater if we could set it from the configuration rather than append it. i.e. config of webhdfs://server/wa/webhdfs/v1 would be used as-is (http://server/wa/webhdfs/v1) rather than becoming http://server/webhdfs/v1/wa/webhdfs/v1.

n.b. this is fairly easy to work around so it not urgent.

ldbiz commented 9 months ago

@anjackson would you provide an example of how this would be seen in action to reproduce and test?

anjackson commented 9 months ago

Thanks for checking, but at thing point I think it's not worth pursuing this any further. Any configuration we need can be handled in the https://github.com/ukwa/ukwa-warc-server that locates the WARCs.