search

plumi / plumi.app

plumi video sharing
plumi.org
108 stars 62 forks source link

BitTorrent Functionality #217

Closed mgogoulos closed 6 years ago

mgogoulos commented 6 years ago

Reported by and on 4 Jul 2007 22:01 UTC automatic creation and seeding of videos via bittorrent

mgogoulos commented 6 years ago

Modified by and on 8 Jul 2007 23:51 UTC

mgogoulos commented 6 years ago

Comment by shrikant on 30 Jan 2008 09:09 UTC just stumbled over a small problem in /opt/plumi-trunk/ATMediaFile/bt-server/INSTALL.txt

1.3. Python bindings for BitTorrent change to BitTorrent directory $ sudo python24 setup.py install

what is meant by 'BitTorrent directory'? Is that the directory where I want to keep my files? maybe the docs should be a bit more verbose there.

mgogoulos commented 6 years ago

Comment by andycat on 25 Mar 2008 06:43 UTC http://wiki.songbirdnest.com/index.php/BitTorrent_Manager_Architecture

mgogoulos commented 6 years ago

Modified by and on 8 Jul 2008 17:45 UTC

mgogoulos commented 6 years ago

Modified by and on 15 Sep 2010 09:44 UTC

mgogoulos commented 6 years ago

Modified by anna on 26 Oct 2010 13:17 UTC

mgogoulos commented 6 years ago

Comment by and on 31 Oct 2010 13:09 UTC Info from J re pushing torrents automatically to torrent trackers

"you can add the trackers while creating the torrent, to get listed on the sites you have to upload with there /upload form or contact each site and figure out how to do it via scripts, i.e. pirate bay you need to enter captchas unless you get a vip account, with that you can script it more easily. some others would also accept atom/rss feeds with links to torrents and would pull them in."

mgogoulos commented 6 years ago

Modified by and on 1 Nov 2010 13:35 UTC

mgogoulos commented 6 years ago

Comment by anna on 3 Dec 2010 01:06 UTC Have added changes to ticket description as per meeting with Mike this morning (feel free to change if inaccurate).

mgogoulos commented 6 years ago

Comment by mike on 20 Jan 2011 20:09 UTC We've built collective.seeder, a product that whenever a new file (video) is uploaded, it symlinks it's blob file to the original file name, and creates a torrent for it.

You can specify as many torrent trackers (announce urls) as you want. This way, we can set up our own tracker, plus add openbittorent (piratebay) and other open trackers. I've updated testing.plumi.org which is now working with the openbittorent tracker. (A note to transmission bittorrent client users: transmission does not yet support trackers with udp urls so they can not connect to openbittorrent and a couple of other trackers. If they're lucky they might get it through DHT).

This enables our torrents to stay alive if one or two trackers go down.

I've also tested a local tracker (xbtt) these days that we can set up for em.org, although there are things to be discussed (better via skype) before proceeding with it.

I've also set up a torrent client daemon (deluged) on testing.plumi.org that automatically starts seeding new torrents.

mgogoulos commented 6 years ago

Comment by mike on 20 Jan 2011 20:25 UTC Example:http://testing.plumi.org/Members/clopy/videos/dsfs/

mgogoulos commented 6 years ago

Comment by anna on 21 Jan 2011 05:30 UTC hey, the testing site was down today, dave got it back up, but i see "S = 0" below the flashplayer, which i imagine means seeders = 0?

can't see any link, or way to download the file via BT.

mgogoulos commented 6 years ago

Comment by anna on 21 Jan 2011 08:03 UTC The control panel looks good here: http://testing.plumi.org/@@seeder-controlpanel

I haven't tested adding any other trackers as I'm not sure which to add.

But as Mike said, it makes sense to use multiple open trackers maintained by others, rather than running our own, given that the client we are using can provide info re. seeders/leechers.

mgogoulos commented 6 years ago

Comment by anna on 21 Jan 2011 08:47 UTC http://testing.plumi.org/Members/clopy/videos/dsfs/

Tested this using Transmission. Successfully downloaded, after looking not-available for about 30 seconds (no seeders were listed during this time). Would have tried on another client if I had time, but don't tonight.

Shame that Transmission isn't a reliable option - what cross-platform client should we recommend? Can we prompt users to use this client using a tooltip / alt-text, or some other UI signpost?

Re. UI - Font size on video view page needs increasing to be the same as "Download / Watch Ogg Theora Version". Also it should say "Seeders" not "S".

mgogoulos commented 6 years ago

Modified by mike on 23 Jan 2011 23:16 UTC

mgogoulos commented 6 years ago

Comment by anna on 24 Jan 2011 03:31 UTC

  1. I just uploaded a new video to testing site to test this. 15 minutes later no BitTorrent link had appeared in the view page: http://testing.plumi.org/Members/anna/videos/climate-change/

Is this enabled on testing.plumi.org to work for new videos as they are added? This would be good in order to test properly.

  1. I just tested the existing test file clopy added using uTorrent. It downloaded successfully - but 10 minutes later, only 1 Seeder is still listed in the page. I am seeding this from my computer. http://testing.plumi.org/Members/clopy/videos/dsfs/

Can you show me somewhere that these statistics are updating correctly? They don't seem to be as far as I can tell.

  1. How long should we anticipate wait times for torrents to be created and seeded by Deluge, and how long until the Seeder stats are updated? Without this info I can't test effectively.
mgogoulos commented 6 years ago

Comment by anna on 24 Jan 2011 03:49 UTC relating to 2. - half an hour later Seeders were still 1, even though I was seeding it myself (should be 2)

mgogoulos commented 6 years ago

Comment by anna on 24 Jan 2011 05:20 UTC relating to 2. - about 2 hours later i checked the page again and now it says Seeders = 2. So it does appear to work, just has a considerable lag. is there any way to bring this time lag down, or should we just have to live with this?

mgogoulos commented 6 years ago

Comment by mike on 24 Jan 2011 17:48 UTC There was an issue with mktorrent and zope. We've dumped mktorrent and are now creating the torrents ourselves. Normally there shouldn't be any delay for the creation of the torrent files from now on. I just tested it on a new video: http://testing.plumi.org/Members/clopy/videos/torrent1/

Seeders are updated every time our torrent client requests an update from the torrent tracker. Forcing it to update the stats sooner could get our IP banned from the tracker for some trackers. With more trackers on the torrent list, we should have shorter update times though.

mgogoulos commented 6 years ago

Comment by anna on 25 Jan 2011 02:07 UTC Wow, this works beautifully. Torrent appeared very quickly (as soon as the page had reloaded). Torrent downloaded perfectly.

Will be interesting to see the impact of multiple trackers on the delay on the statistics, but this is totally fine for now. I imagine that for many videos the torrent will only be seeded by us in any case, but perhaps in the use-case of the Indo TV stations they will be seeding content over long periods of time so delays in statistics will not be such an issue anyhow.

Ticking this off, it's so exciting to see this working so well!!! Big congrats :)

mgogoulos commented 6 years ago

Modified by anna on 25 Jan 2011 02:08 UTC

mgogoulos commented 6 years ago

Comment by andyman on 13 Dec 2011 21:32 UTC @mike

see https://trac.transmissionbt.com/ticket/117 You might want to know that a whopping FIVE YEARS LATER the impossible was made possible: transmission now DOES have UDP support! :) And it works well, albeit uncertain whether any distros are already shipping the UDP-powered version. If things go really bad, you will have to compile the release yourself.

Andy