internetarchive / dweb-gateway

Decentralized web Gateway for Internet Archive
GNU Affero General Public License v3.0
21 stars 5 forks source link

Torrent file rewrite #34

Open mitra42 opened 6 years ago

mitra42 commented 6 years ago

When https://github.com/internetarchive/dweb-transport/issues/22 and https://github.com/internetarchive/dweb-gateway/issues/33 are fixed we need to rewrite Torrent files, at ingestion and either on the fly, or via a batch process.

Code for rewriting on the fly is in Archive.py that code will need trivially rewriting to use the URL format from https://github.com/internetarchive/dweb-gateway/issues/33 and the URL from https://github.com/internetarchive/dweb-transport/issues/22.

The code (or existing ingestion code) could be adapted for writing on ingestion, or for rewriting as a batch process.

Sam also suggested asking WebTorrent to try https & ws if tracker only supports http URLs since they are obviously unusable in webtorrent. https://github.com/internetarchive/dweb-transports/issues/5

mitra42 commented 6 years ago

The rewrites required are: Replace http://bt1.archive.org with https://bt1.archive.org & wss://bt1.archive.org Same for bt2 Replace download URLS with link to gateway or when #33 is done, with the https link