search

sergiotapia / magnetissimo

Web application that indexes all popular torrent sites, and saves it to the local database.
MIT License
3k stars 190 forks source link

Add Isohunt crawler to the project #47

Closed sergiotapia closed 6 years ago

sergiotapia commented 7 years ago

Parser is working and verified using unit tests.

Unfortunately during actual processing we get :timeout errors. I need to figure out what's up.

→ mix phoenix.server
[info] Running Magnetissimo.Endpoint with Cowboy using http://localhost:4000
Downloading page: https://isohunt.to/latest.php?Torrent_page=0
:timeout
Downloading page: https://isohunt.to/latest.php?Torrent_page=40
:timeout
Downloading page: https://isohunt.to/latest.php?Torrent_page=80
:timeout
Downloading page: https://isohunt.to/latest.php?Torrent_page=120

This change is Reviewable

ThatLurker commented 6 years ago

Isohunts current domain is https://isohunts.to i think. The site is a pit weird wanting you install their own tools and such tough.

tchoutri commented 6 years ago

Yeah I have quite a bad feeling about this one :/
Might not worth the effort for now, their website is suspiciously weird

sergiotapia commented 6 years ago

Let's move on from Isohunt, plenty of other cleaner options.