search

AshwinAmbal / DarkWeb-Crawling-Indexing

A DarkWeb Crawler based off the open-source TorSpider. Indexing with search engine created using Apache Solr.
Apache License 2.0
34 stars 16 forks source link

Confusion around "Give the password inside /Modules/Scrape.py" #7

Open adchdev opened 1 year ago

adchdev commented 1 year ago

Hi, I am not sure what to do with this instruction in the readme:

Give the password inside /Modules/Scrape.py from stem.control import Controller with Controller.from_port(port = 9051) as controller: controller.authenticate("your_password_hash") controller.signal(Signal.NEWNYM)

Which Modules folder?

guneetsura commented 1 year ago

Me neither.

Although I tried creating a Modules folder in 'crawl' folder itself and I added the code on 'Scrape.py' file. I also added the onion links in the txt file that is mentioned in the readme file. The code does not seem to work.

Traceback (most recent call last): File "/home/kali/Downloads/DarkWeb-Crawling-Indexing-master/Code/crawler/main.py", line 1, in from crawl_bot import Crawl_bot File "/home/kali/Downloads/DarkWeb-Crawling-Indexing-master/Code/crawler/crawl_bot.py", line 11, in import socks, socket File "/home/kali/.local/lib/python3.10/site-packages/socks.py", line 65, in from collections import Callable ImportError: cannot import name 'Callable' from 'collections' (/usr/lib/python3.10/collections/init.py) Traceback (most recent call last): File "/home/kali/Downloads/DarkWeb-Crawling-Indexing-master/Code/crawler/main.py", line 1, in from crawl_bot import Crawl_bot File "/home/kali/Downloads/DarkWeb-Crawling-Indexing-master/Code/crawler/crawl_bot.py", line 11, in import socks, socket File "/home/kali/.local/lib/python3.10/site-packages/socks.py", line 65, in from collections import Callable ImportError: cannot import name 'Callable' from 'collections' (/usr/lib/python3.10/collections/init.py)