aboul3la / Sublist3r

Fast subdomains enumeration tool for penetration testers
GNU General Public License v2.0
9.67k stars 2.09k forks source link

Process ThreatCrowd-10: #190

Open kirillivan0ff opened 4 years ago

kirillivan0ff commented 4 years ago

Hi all. Didn't found anything useful about this issue. Any advices how to fix?

`:~/Sublist3r/Sublist3r$ python sublist3r.py -d google.com

             ____        _     _ _     _   _____
            / ___| _   _| |__ | (_)___| |_|___ / _ __
            \___ \| | | | '_ \| | / __| __| |_ \| '__|
             ___) | |_| | |_) | | \__ \ |_ ___) | |
            |____/ \__,_|_.__/|_|_|___/\__|____/|_|

            # Coded By Ahmed Aboul-Ela - @aboul3la

[-] Enumerating subdomains now for google.com [-] Searching now in Baidu.. [-] Searching now in Yahoo.. [-] Searching now in Google.. [-] Searching now in Bing.. [-] Searching now in Ask.. [-] Searching now in Netcraft.. [-] Searching now in DNSdumpster.. [-] Searching now in Virustotal.. [-] Searching now in ThreatCrowd.. [-] Searching now in SSL Certificates.. [-] Searching now in PassiveDNS.. Process ThreatCrowd-10: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() File "sublist3r.py", line 269, in run domain_list = self.enumerate() File "sublist3r.py", line 746, in enumerate resp = self.req(url) File "sublist3r.py", line 738, in req resp = self.session.get(url, headers=self.headers, timeout=self.timeout) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 546, in get return self.request('GET', url, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 646, in send r = adapter.send(request, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 449, in send timeout=timeout File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 672, in urlopen chunked=chunked, File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 376, in _make_request self._validate_conn(conn) File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 994, in _validate_conn conn.connect() File "/usr/local/lib/python2.7/dist-packages/urllib3/connection.py", line 334, in connect conn = self._new_conn() File "/usr/local/lib/python2.7/dist-packages/urllib3/connection.py", line 157, in _new_conn (self._dns_host, self.port), self.timeout, extra_kw File "/usr/local/lib/python2.7/dist-packages/urllib3/util/connection.py", line 61, in create_connection for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): KeyboardInterrupt Process DNSdumpster-8: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() File "sublist3r.py", line 269, in run domain_list = self.enumerate() File "sublist3r.py", line 645, in enumerate token = self.get_csrftoken(resp) File "sublist3r.py", line 640, in get_csrftoken token = csrf_regex.findall(resp)[0] IndexError: list index out of range Process Virustotal-9: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() File "sublist3r.py", line 269, in run domain_list = self.enumerate() File "sublist3r.py", line 698, in enumerate resp = self.send_req(self.url) File "sublist3r.py", line 688, in send_req resp = self.session.get(url, headers=self.headers, timeout=self.timeout) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 546, in get return self.request('GET', url, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 646, in send r = adapter.send(request, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 449, in send timeout=timeout File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 672, in urlopen chunked=chunked, File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 376, in _make_request self._validate_conn(conn) File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 994, in _validate_conn conn.connect() File "/usr/local/lib/python2.7/dist-packages/urllib3/connection.py", line 334, in connect conn = self._new_conn() File "/usr/local/lib/python2.7/dist-packages/urllib3/connection.py", line 157, in _new_conn (self._dns_host, self.port), self.timeout, extra_kw File "/usr/local/lib/python2.7/dist-packages/urllib3/util/connection.py", line 61, in create_connection for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM): KeyboardInterrupt Process CrtSearch-11: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() File "sublist3r.py", line 269, in run domain_list = self.enumerate() File "sublist3r.py", line 785, in enumerate resp = self.req(url) File "sublist3r.py", line 777, in req resp = self.session.get(url, headers=self.headers, timeout=self.timeout) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 546, in get return self.request('GET', url, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 646, in send r = adapter.send(request, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 449, in send timeout=timeout File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 672, in urlopen chunked=chunked, File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 376, in _make_request self._validate_conn(conn) File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 994, in _validate_conn conn.connect() File "/usr/local/lib/python2.7/dist-packages/urllib3/connection.py", line 334, in connect conn = self._new_conn() File "/usr/local/lib/python2.7/dist-packages/urllib3/connection.py", line 157, in _new_conn (self._dns_host, self.port), self.timeout, extra_kw KeyboardInterrupt ^CProcess BaiduEnum-2: Traceback (most recent call last): Traceback (most recent call last): File "sublist3r.py", line 1001, in File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() Process YahooEnum-3: File "sublist3r.py", line 269, in run Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap interactive() File "sublist3r.py", line 998, in interactive self.run() File "sublist3r.py", line 269, in run res = main(domain, threads, savefile, ports, silent=False, verbose=verbose, enable_bruteforce=enable_bruteforce, engines=engines) File "sublist3r.py", line 942, in main domain_list = self.enumerate() File "sublist3r.py", line 254, in enumerate self.should_sleep() File "sublist3r.py", line 511, in should_sleep time.sleep(random.randint(2, 5)) KeyboardInterrupt enum.join() File "/usr/lib/python2.7/multiprocessing/process.py", line 148, in join res = self._popen.wait(timeout) File "/usr/lib/python2.7/multiprocessing/forking.py", line 154, in wait domain_list = self.enumerate() File "sublist3r.py", line 237, in enumerate resp = self.send_req(query, page_no) return self.poll(0) File "/usr/lib/python2.7/multiprocessing/forking.py", line 135, in poll File "sublist3r.py", line 176, in send_req resp = self.session.get(url, headers=self.headers, timeout=self.timeout) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 546, in get pid, sts = os.waitpid(self.pid, flag) KeyboardInterrupt return self.request('GET', url, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 646, in send r = adapter.send(request, **kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 449, in send timeout=timeout File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 672, in urlopen chunked=chunked, File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 412, in _make_request httplib_response = conn.getresponse(buffering=True) File "/usr/lib/python2.7/httplib.py", line 1137, in getresponse response.begin() File "/usr/lib/python2.7/httplib.py", line 448, in begin version, status, reason = self._read_status() File "/usr/lib/python2.7/httplib.py", line 404, in _read_status line = self.fp.readline(_MAXLINE + 1) File "/usr/lib/python2.7/socket.py", line 480, in readline data = self._sock.recv(self._rbufsize) File "/usr/lib/python2.7/ssl.py", line 754, in recv return self.read(buflen) File "/usr/lib/python2.7/ssl.py", line 641, in read v = self._sslobj.read(len) KeyboardInterrupt `

kirillivan0ff commented 4 years ago

Or Process DNSdumpster-8:

`$ ./sublist3r.py -d google.com

             ____        _     _ _     _   _____
            / ___| _   _| |__ | (_)___| |_|___ / _ __
            \___ \| | | | '_ \| | / __| __| |_ \| '__|
             ___) | |_| | |_) | | \__ \ |_ ___) | |
            |____/ \__,_|_.__/|_|_|___/\__|____/|_|

            # Coded By Ahmed Aboul-Ela - @aboul3la

[-] Enumerating subdomains now for google.com [-] Searching now in Baidu.. [-] Searching now in Yahoo.. [-] Searching now in Google.. [-] Searching now in Bing.. [-] Searching now in Ask.. [-] Searching now in Netcraft.. [-] Searching now in DNSdumpster.. [-] Searching now in Virustotal.. [-] Searching now in ThreatCrowd.. [-] Searching now in SSL Certificates.. [-] Searching now in PassiveDNS.. Process DNSdumpster-8: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap self.run() File "./sublist3r.py", line 269, in run domain_list = self.enumerate() File "./sublist3r.py", line 645, in enumerate token = self.get_csrftoken(resp) File "./sublist3r.py", line 640, in get_csrftoken token = csrf_regex.findall(resp)[0] IndexError: list index out of range [!] Error: Virustotal probably now is blocking our requests ^CProcess BaiduEnum-2: Process GoogleEnum-4: Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap Traceback (most recent call last): Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap File "./sublist3r.py", line 1001, in self.run() File "./sublist3r.py", line 269, in run Process CrtSearch-11: Process YahooEnum-3: Traceback (most recent call last): self.run() Traceback (most recent call last): File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap File "./sublist3r.py", line 269, in run File "/usr/lib/python2.7/multiprocessing/process.py", line 267, in _bootstrap interactive() File "./sublist3r.py", line 998, in interactive self.run() File "./sublist3r.py", line 269, in run domain_list = self.enumerate() self.run() File "./sublist3r.py", line 254, in enumerate File "./sublist3r.py", line 269, in run self.should_sleep() File "./sublist3r.py", line 511, in should_sleep time.sleep(random.randint(2, 5)) res = main(domain, threads, savefile, ports, silent=False, verbose=verbose, enable_bruteforce=enable_bruteforce, engines=engines) File "./sublist3r.py", line 942, in main KeyboardInterrupt domain_list = self.enumerate() File "./sublist3r.py", line 254, in enumerate self.should_sleep() File "./sublist3r.py", line 311, in should_sleep time.sleep(5) KeyboardInterrupt enum.join() domain_list = self.enumerate() File "/usr/lib/python2.7/multiprocessing/process.py", line 148, in join File "./sublist3r.py", line 785, in enumerate resp = self.req(url) res = self._popen.wait(timeout) File "./sublist3r.py", line 777, in req File "/usr/lib/python2.7/multiprocessing/forking.py", line 154, in wait domain_list = self.enumerate() resp = self.session.get(url, headers=self.headers, timeout=self.timeout) File "./sublist3r.py", line 237, in enumerate File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 546, in get resp = self.send_req(query, page_no) return self.poll(0) File "./sublist3r.py", line 176, in send_req File "/usr/lib/python2.7/multiprocessing/forking.py", line 135, in poll resp = self.session.get(url, headers=self.headers, timeout=self.timeout) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 546, in get pid, sts = os.waitpid(self.pid, flag) KeyboardInterrupt return self.request('GET', url, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 646, in send r = adapter.send(request, kwargs) return self.request('GET', url, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 449, in send File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 533, in request resp = self.send(prep, send_kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 646, in send r = adapter.send(request, kwargs) File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 449, in send timeout=timeout File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 672, in urlopen timeout=timeout File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 672, in urlopen chunked=chunked, File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 412, in _make_request httplib_response = conn.getresponse(buffering=True) File "/usr/lib/python2.7/httplib.py", line 1137, in getresponse chunked=chunked, File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 412, in _make_request httplib_response = conn.getresponse(buffering=True) File "/usr/lib/python2.7/httplib.py", line 1137, in getresponse response.begin() File "/usr/lib/python2.7/httplib.py", line 448, in begin version, status, reason = self._read_status() File "/usr/lib/python2.7/httplib.py", line 404, in _read_status line = self.fp.readline(_MAXLINE + 1) File "/usr/lib/python2.7/socket.py", line 480, in readline response.begin() File "/usr/lib/python2.7/httplib.py", line 448, in begin version, status, reason = self._read_status() File "/usr/lib/python2.7/httplib.py", line 404, in _read_status line = self.fp.readline(_MAXLINE + 1) File "/usr/lib/python2.7/socket.py", line 480, in readline data = self._sock.recv(self._rbufsize) File "/usr/lib/python2.7/ssl.py", line 754, in recv data = self._sock.recv(self._rbufsize) File "/usr/lib/python2.7/ssl.py", line 754, in recv return self.read(buflen) File "/usr/lib/python2.7/ssl.py", line 641, in read v = self._sslobj.read(len) return self.read(buflen) File "/usr/lib/python2.7/ssl.py", line 641, in read KeyboardInterrupt v = self._sslobj.read(len) KeyboardInterrupt `

latest-release commented 4 years ago

The Majority of the sources listed there no longer work. DNSdumpster raises 403. I maintain a local copy of sublist3r that i use here https://www.nmmapper.com/sys/tools/subdomainfinder/ . As far as i maintain only the following sources still work in sublist3r NetcraftEnum, ThreatCrowd, Virustotal, CrtSearch