search

samirettali / tor-spider

A spider for Hidden Services
4 stars 0 forks source link

[Suggestion] list on onions to crawl with their tags #2

Closed ghost closed 4 years ago

ghost commented 4 years ago

Hi,

Hope you are all well !

I found that list of onions with their tags: https://github.com/onionltd/oniontree

It would be awesome to keep the tags for classifying at least the onion's home page and to bulk crawl this list of onions.

What do you think ?

Cheers, X

ghost commented 4 years ago

Here is a large dataset of onions, https://github.com/x0rzkov/tor-spider/blob/master/shared/dataset/onions.csv. I do not what they are but I found them across the clear web.