search

megadose / OnionSearch

OnionSearch is a script that scrapes urls on different .onion search engines.
GNU General Public License v3.0
1.16k stars 153 forks source link

url links format #36

Open Concorde34 opened 6 months ago

Concorde34 commented 6 months ago

the links are still displayed in this form:

"onionland","Tor Browser User Manual | Tor Project | Tor Browser Manual","eyJpdiI6InFHMmJhTXVFT0NXK0haZmFORmpodFE9PSIsInZhbHVlIjoiMnBYTG15RUg5Zk9CY21yT2dWdXBoc0pZRURybHhaRnA2WkRFM1N5XC8zWTl2VHBtMnF5NU5IdSs5S2JrU0gxc2swTmNlVTc5azZpRjk0bDBUXC9GR05FeU9BblFTVzg1dnNYdnZwM2dxXC9ENGs9IiwibWFjIjoiMzQ5NTE1N2QzZjkwMWFjYmY4ZjI5YTdlYWI4YWM4NTU4NGVkYWJiNjljMzI4MjYyN2JjNWFhN2M3ZGMzNzI4MyJ9"

Headings are ok but links are unreadable

And during the search I was confused by errors. Perhaps this is due to the fact that some search engines do not work

search.py started with 3 processing units...
Ahmia (#0):   0%|                                                        | 0/1 [00:00<?, ?it/s]
Exception occured: SOCKSHTTPConnectionPool(host='msydqstlz2kzerdg.onion', port=80): Max retries exceeded with url: /search/?q=tor%20browser (Caused by NewConnectionError('<urllib3.contrib.socks.SOCKSConnection object at 0x7f59324c4b50>: Failed to establish a new connection: 0x01: General SOCKS server failure'))
Torgle (#0):   0%|                                                        | 0/1 [00:00<?, ?it/s]Exception occured: SOCKSHTTPConnectionPool(host='l4rsciqnpzdndt2llgjx3luvnxip7vbyj6k6nmdy4xs77tx6gkd24ead.onion', port=80): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.contrib.socks.SOCKSConnection object at 0x7f59324c07d0>: Failed to establish a new connection: 0x04: Host unreachable'))

But other search engines work and provide links

macgreine commented 3 months ago

I edited ahmia to ahmia.fi and it spits out tons. Some of the search engines are no longer active. I get about 6 search engines to respond. I found a mirror for notevil but have not been able to get results from it. But it too spits out tons if I go to the search engine link and search.