search

JCB9090 / juan-carlos-torrents-2

Stream torrents from KAT.cr in Stremio - successor to "Juan Carlos Torrents"
45 stars 11 forks source link

download torrent meta / uploaders/downloaders #3

Open JCB9090 opened 8 years ago

JCB9090 commented 8 years ago

this is the main issue of this add-on

it's based on software that can crawl/process many torrent sites / sources, so it has no trouble working after yts / eztv are gone

but now it has to sift through sources like the kat.cr dumps / bitsnoop dump, which means getting meta and seed-leech count for many torrents that aren't of any interest -i.e. aren't movies/tv episodes

which means it has to take a much larger load, and with trackers / torcache being kind of rate-limited, that's the reason for new episodes / movies not coming fast enough

Any good ideas for taking large amounts of quality movies / series torrents quickly? i've estimated that the streamable movie/series torrents are around 30 000, and we now have to sift through millions from dumps to potentially identify them

bitsnoop tracker dump seems viable at first, but many well seeded torrents are reported as 0/0 there

oVerde commented 8 years ago

I don't know if TorCache is the best here, could use magnet if .torrent isn't viable? You could do a two pass, first to index which movies are available and then a second pass to get seeders. For the lazy load, I see two options, cache locally this index, or you'll need to do build this cross index server side (which is less bug prone, client is always trust less).

kodaxx commented 8 years ago

I used to use a userscript that pulled all the best magnet links from TPB...somehow it sorted them and always gave me great links. It was made in JavaScript as is this - I'm no expert, so maybe you can decipher this and see if it will help you at all: http://userscripts-mirror.org/scripts/source/38484.user.js

JCB9090 commented 8 years ago

@oVerde we can use magnets, but retrieving meta from magnets takes a lot of time

tsoernes commented 8 years ago

How does this work? Do you pull the nightly kat.cr dump to a server, filter it, and then serve it yourself to the plug-in?

JCB9090 commented 8 years ago

@tsoernes look at the multipass.cfg.js file. no dumps yet as they won't give access to the api - as i have an acc at kat for a short time

but yes, generally works exactly like that - crawls kat.cr, indexes the torrents, filters and serves to stremio through the add-on protocol

Holsted777 commented 8 years ago

Maybe this API can be useful?

https://torrentproject.se/api