kiwix / operations

Kiwix Kubernetes Cluster
http://charts.k8s.kiwix.org/
7 stars 0 forks source link

Magnet download of noted.lol is not working #294

Closed benoit74 closed 2 weeks ago

benoit74 commented 2 weeks ago

I'm trying to download via magnet link noted.lol ZIM from https://library.kiwix.org/#lang=eng&q=noted

Magnet link is

magnet:?
&xt=urn:btih:e74186d5df61550a1f8206f9bc01e38087ececee
&xt=urn:md5:f07bbc038357a3186ec65c304488e5ee
&xl=1380001806
&dn=noted.lol_en_all_2024-10.zim
&as=http%3A%2F%2Fdownload.kiwix.org%2Fzim%2Fzimit%2Fnoted.lol_en_all_2024-10.zim
&tr=http%3A%2F%2Ftracker.openzim.org%3A6969%2Fannounce
&tr=udp%3A%2F%2Ftracker.openzim.org%3A6969%2Fannounce%0A
&ws=http%3A%2F%2Fdownload.kiwix.org%2Fzim%2Fzimit%2Fnoted.lol_en_all_2024-10.zim
&xs=http%3A%2F%2Fdownload.kiwix.org%2Fzim%2Fzimit%2Fnoted.lol_en_all_2024-10.zim.torrent

Transmission stays stuck with "torrent metadata needed":

Image

I'm using Transmission 4.0.6 (38c164933e) on Mac OS Sonoma 14.5 (Apple Silicon).

Note that the ZIM has been very recently (yesterday) pushed to storage / published in library.

Adding to Transmission the torrent manually downloaded from xs attribute above works like a charm.

@rgaudin can you please have a look, I'm not that experienced with magnet links and I honestly don't get what could be wrong here

rgaudin commented 2 weeks ago

Mirrobrain's magnet

magnet:?xt=urn:btih:e74186d5df61550a1f8206f9bc01e38087ececee
&xt=urn:md5:f07bbc038357a3186ec65c304488e5ee
&xl=1380001806
&dn=noted.lol_en_all_2024-10.zim
&as=http://download.kiwix.org/zim/zimit/noted.lol_en_all_2024-10.zim
&tr=http://tracker.openzim.org:6969/announce
&tr=udp://tracker.openzim.org:6969/announce
benoit74 commented 2 weeks ago

This is "normal", it looks like transmission is not using the xs parameter at all: https://github.com/transmission/transmission/issues/317 ; so it waits for peers to download metadata

rgaudin commented 2 weeks ago

Indeed, as verified with @benoit74, there are very few torrent clients that supports automatically downloading the .torrent file themselves from the the xs key.

This means that for them, even a webseed-able magnet is not enough if there is no peer providing the metadata. This makes #43 very important.

Clients supporting xs:

We did found a bug that affects qbittorrent: https://github.com/kiwix/libkiwix/issues/1157