alternatives to dhtcrawler2

[milahu]

magnetico

• https://github.com/boramalper/magnetico
• archived
• 3K github stars
• last commit 2022
• written in: Go

magnetico: Autonomous (self-hosted) BitTorrent DHT search engine suite. magnetico is the first autonomous (self-hosted) BitTorrent DHT search engine suite that is designed for end-users. The suite consists of two packages: - magneticod: Autonomous BitTorrent DHT crawler and metadata fetcher. - magneticow: Lightweight web interface for magnetico. Both programs, combined together, allows anyone with a decent Internet connection to access the vast amount of torrents waiting to be discovered within the BitTorrent DHT space, without relying on any central entity. magnetico liberates BitTorrent from the yoke of centralised trackers & web-sites and makes it truly decentralised. Finally!

magnetico forks

• https://github.com/tgragnato/magnetico - 30 github stars, last commit 2024
• https://github.com/ireun/magnetico - 15 github stars, last commit 2022
• https://github.com/ez-me/magnetico - 10 github stars, last commit 2023

magnetico issues

https://github.com/boramalper/magnetico/issues

use postgreSQL

• https://github.com/boramalper/magnetico/issues/264
• https://github.com/boramalper/magnetico/issues/280
  • switch to postgres database increases performance by about 4 times on my server

DHT database dumps

todo: these should be sqlite files, so they can be used directly, without unpacking

• https://github.com/boramalper/magnetico/issues/218
  • https://tnt.maiti.info/dhtd/
  • https://antipoul.fr/dhtd/ - last release: 2023
  • https://www.kescher.at/magneticod-db - last release: 2021
  • https://framagit.org/Glandos/magnetico_merge - merge sqlite databases

DHT database sharing

• https://github.com/boramalper/magnetico/issues/187

distributed crawling

• https://github.com/boramalper/magnetico/issues/155
• https://github.com/boramalper/magnetico/issues/106
• https://github.com/boramalper/magnetico/issues/23

shiyanhui/dht

• https://github.com/shiyanhui/dht
• written in: Go
• 3K github stars
• last commit 2020

bitmagnet

• https://github.com/bitmagnet-io/bitmagnet
• written in: Go
• 2K github stars
• last commit 2024

dhtbay

• https://github.com/FlyersWeb/dhtbay
• written in: JavaScript
• 100 github stars
• last commit 2018

dhtsearch

• https://github.com/felix/dhtsearch
• written in: Go
• 50 github stars
• last commit 2020

hamster

• https://github.com/picotorrent/hamster
• written in: Go
• 5 github stars
• last commit 2022

[tuxayo]

Is there any public instance of any of these? (those who have a web interface at least)

[ralyodio]

https://www.npmjs.com/package/torrent-search-api-for-barbaroussa

this is the only search module I found that works and it only works on 1337x

[milahu]

Is there any public instance of any of these?

not really. only the usual torrent search engines... btdig.com torrentz2.nz solidtorrents.to snowfl.com damag.net 1337x.to

maybe magnetico and bitmagnet are used as scrapers in the backend