search

blacklanternsecurity / bbot

A recursive internet scanner for hackers.
https://www.blacklanternsecurity.com/bbot/
GNU General Public License v3.0
4.43k stars 396 forks source link

RuntimeWarning: coroutine 'subdomain_enum.abort_if' was never awaited #827

Closed github-notafake-contact closed 10 months ago

github-notafake-contact commented 10 months ago

I have consistently gotten this error every time I run BBOT for the past few months. Not sure if it's something I'm doing wrong, but this error has been persistent through multiple installs over the past ~ 2 or 3 months. Use BBOT pretty consistently for work during pentest engagements (TrustedSec sends their love 😘).

The error:

/home/ubuntu/.local/pipx/venvs/bbot/lib/python3.11/site-packages/bbot/scanner/manager.py:100: RuntimeWarning: coroutine 'subdomain_enum.abort_if' was never awaited
  await self._emit_event(event, *args, **kwargs)

Things I have tried:

I've attempted to rule out if the issue was stemming from my Ubuntu VM, so I launched two AWS EC2 instances and installed BBOT on those. One instances was t4.micro Ubuntu 22.04 Server and the other m4.large Ubuntu Server 18.04. Again, same error both times.

There was a time when I didn't get this error. However, that was months ago and I don't remember what version was installed BBOT or what my config file looked like...

Here is my latest install attempt tried today on a brand new EC2 instance running Ubuntu Server 22.04:

NOTE: I run ZSH instead of BASH. Unsure if this is relevant but still noting here just in case.

NOTE: I use pyenv for all Python related things. Every Python tool gets its own virtual environment (e.g. Impacket, Scapy, SubBrute, Frida, Requests, etc...) and have had little to no issues. That said, I'm not ruling out pyenv as being the issue so I'll include how I setup my BBOT environment as well.

Complete Environment Setup and BBOT Install:

sudo apt install -y build-essential pip libedit-dev zlib1g zlib1g-dev libssl-dev libbz2-dev libsqlite3-dev make libffi-dev libncurses5-dev libreadline-dev liblzma-dev
curl https://pyenv.run | bash
pyenv update
pyenv install 3.11 # I've tried this on Python 3.8 and 3.10 as well in the past.
pyenv virtualenv 3.11 BBOT
pyenv global BBOT
pyenv activate BBOT # Can never be too sure lol
pip install --upgrade pip
pip install pipx
pipx ensurepath

--- launch new shell ---

pyenv activate BBOT # Again, just in case...
pipx install --pip-args '\--pre' bbot
bbot --install-all-deps
# Setup API keys in secrets.yml here
bbot -t honeybadger.page -f safe

The entire output:

[WARN] This is a (safe) active scan. Non-intrusive connections will be made to target
[WARN] You have enabled the following slow modules: bucket_digitalocean,fingerprintx. Scan may take a while
[INFO] Scan with 67 modules seeded with 1 targets
[INFO] Loaded 67/67 scan modules (affiliates,aggregate,anubisdb,asn,azure_realm,azure_tenant,badsecrets,bevigil,binaryedge,bucket_aws,bucket_azure,bucket_digitalocean,bucket_firebase,bucket_gcp,c99,censys,certspotter,chaos,columbus,credshed,crobat,crt,digitorus,dnscommonsrv,dnsdumpster,dnszonetransfer,emailformat,filedownload,fingerprintx,fullhunt,git,github,gowitness,hackertarget,httpx,hunt,hunterio,iis_shortnames,ip2location,leakix,myssl,nsec,ntlm,oauth,otx,passivetotal,pgp,rapiddns,riddler,robots,secretsdb,securitytrails,shodan_dns,sitedossier,skymem,social,sslcert,subdomain_hijack,subdomaincenter,sublist3r,threatminer,urlscan,viewdns,virustotal,wappalyzer,wayback,zoomeye)
[INFO] Loaded 3/3 internal modules (aggregate,excavate,speculate)
[INFO] Loaded 6/6 output modules, (asset_inventory,csv,human,json,subdomains,web_report)
[INFO] Setting up modules...
[SUCC] bevigil: API is ready
[SUCC] virustotal: API is ready
[INFO] internal.speculate: No portscanner enabled. Assuming open ports: 80, 443, 8080, 8443, 8834, 9443
[WARN] Setup soft-failed for chaos: No API key set
[WARN] Setup soft-failed for credshed: Must set username, password, and credshed_url
[SUCC] github: API is ready
[SUCC] securitytrails: API is ready
[SUCC] shodan_dns: API is ready
[SUCC] fullhunt: API is ready
[SUCC] binaryedge: API is ready
[SUCC] censys: API is ready
[SUCC] hunterio: API is ready
[SUCC] c99: API is ready
[SUCC] passivetotal: API is ready
[SUCC] leakix: API is ready
[SUCC] zoomeye: API is ready
[WARN] Setup failed for 2 modules
[SUCC] Setup succeeded for 73 modules.
[SUCC] Scan ready. Press enter to execute severe_travis

[SUCC] Starting scan severe_travis
[SCAN]                  severe_travis (SCAN:46d0776b87ee985638ae9cf1d6f7ace927189103)   TARGET  (distance-0)
[DNS_NAME]              honeybadger.page        TARGET  (a-record, aaaa-record, distance-0, domain, in-scope, mx-record, ns-record, resolved, soa-record, target, txt-record)
[OPEN_TCP_PORT]         honeybadger.page:443    speculate       (distance-0, in-scope)
[URL]                   https://honeybadger.page/       httpx   (dir, distance-0, http-title-302-moved, in-scope, ip-216-239-36-21, status-302)
[OPEN_TCP_PORT]         honeybadger.page:80     speculate       (distance-0, in-scope)
[URL]                   http://honeybadger.page/        httpx   (dir, distance-0, http-title-302-moved, in-scope, ip-216-239-34-21, status-302)
[INFO] Loaded defaults from /home/ubuntu/.local/pipx/venvs/bbot/lib/python3.11/site-packages/bbot/defaults.yml
[INFO] Loaded config from /home/ubuntu/.config/bbot/bbot.yml
[INFO] Loaded secrets from /home/ubuntu/.config/bbot/secrets.yml
[INFO] Loaded defaults from /home/ubuntu/.local/pipx/venvs/bbot/lib/python3.11/site-packages/bbot/defaults.yml
[INFO] Loaded config from /home/ubuntu/.config/bbot/bbot.yml
[INFO] Loaded secrets from /home/ubuntu/.config/bbot/secrets.yml
[INFO] sublist3r: Query "honeybadger.page" failed (no response)
[STORAGE_BUCKET]        {"name": "honeybadger", "url": "https://honeybadger.s3.amazonaws.com"}  bucket_aws      (cloud-aws, cloud-storage-bucket, distance-1)
[DNS_NAME]              honeybadger.s3.amazonaws.com    host    (a-record, cloud-aws, cloud-storage-bucket, distance-1, internal, resolved, subdomain)
[STORAGE_BUCKET]        {"name": "honeybadger", "url": "https://honeybadger.s3.amazonaws.com"}  aws_cloud       (cloud-aws, cloud-storage-bucket, distance-1)
[AZURE_TENANT]          {"domains": [], "tenant-names": []}     azure_tenant    (distance-1)
[IP_ADDRESS]            216.239.38.21   A       (distance-1, internal, ipv4, ptr-record, resolved)
[GEOLOCATION]           {'ip': '216.239.38.21', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'Virginia', 'city_name': 'Ashburn', 'latitude': 39.039474, 'longitude': -77.491809, 'zip_code': '20146', 'time_zone': '-04:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False} ip2location     (distance-2)
[STORAGE_BUCKET]        {"name": "honeybadger", "url": "https://www.googleapis.com/storage/v1/b/honeybadger"}   bucket_gcp      (cloud-gcp, distance-1)
[IP_ADDRESS]            216.239.36.21   A       (distance-1, internal, ipv4, ptr-record, resolved)
[GEOLOCATION]           {'ip': '216.239.36.21', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.405992, 'longitude': -122.078515, 'zip_code': '94043', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}        ip2location     (distance-2)
/home/ubuntu/.local/pipx/venvs/bbot/lib/python3.11/site-packages/bbot/scanner/manager.py:100: RuntimeWarning: coroutine 'subdomain_enum.abort_if' was never awaited
  await self._emit_event(event, *args, **kwargs)
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
[IP_ADDRESS]            216.239.38.21   A       (distance-1, internal, ipv4, ptr-record, resolved)
[IP_ADDRESS]            216.239.38.21   A       (distance-1, internal, ipv4, ptr-record, resolved)
[ASN]                   {"asn": "15169", "country": "US", "description": "Google LLC", "name": "GOOGLE", "subnet": "216.239.38.0/24"}   asn     (distance-2)
[ASN]                   {"asn": "15169", "country": "US", "description": "Google LLC", "name": "GOOGLE", "subnet": "216.239.32.0/19"}   asn     (distance-2)
[DNS_NAME]              www.honeybadger.page    certspotter     (a-record, aaaa-record, cname-record, distance-0, in-scope, resolved, subdomain)
[IP_ADDRESS]            216.239.34.21   A       (distance-1, internal, ipv4, ptr-record, resolved)
[GEOLOCATION]           {'ip': '216.239.34.21', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.405992, 'longitude': -122.078515, 'zip_code': '94043', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}        ip2location     (distance-2)
/home/ubuntu/.local/pipx/venvs/bbot/lib/python3.11/site-packages/bbot/scanner/manager.py:100: RuntimeWarning: coroutine 'subdomain_enum.abort_if' was never awaited
  await self._emit_event(event, *args, **kwargs)
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
[DNS_NAME]              source.honeybadger.page securitytrails  (a-record, distance-0, in-scope, resolved, subdomain)
[IP_ADDRESS]            216.239.32.21   A       (distance-1, internal, ipv4, ptr-record, resolved)
[GEOLOCATION]           {'ip': '216.239.32.21', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.405992, 'longitude': -122.078515, 'zip_code': '94043', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}        ip2location     (distance-2)
[IP_ADDRESS]            2001:4860:4802:38::15   AAAA    (distance-1, internal, ipv6, ptr-record, resolved)
[ASN]                   {"asn": "15169", "country": "US", "description": "Google LLC", "name": "GOOGLE", "subnet": "2001:4860::/32"}    asn     (distance-2)
[IP_ADDRESS]            2001:4860:4802:38::15   AAAA    (distance-1, internal, ipv6, ptr-record, resolved)
[GEOLOCATION]           {'ip': '2001:4860:4802:0038:0000:0000:0000:0015', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.38605, 'longitude': -122.08385, 'zip_code': '94041', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}     ip2location      (distance-2)
[IP_ADDRESS]            2001:4860:4802:36::15   AAAA    (distance-1, internal, ipv6, ptr-record, resolved)
[GEOLOCATION]           {'ip': '2001:4860:4802:0036:0000:0000:0000:0015', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.38605, 'longitude': -122.08385, 'zip_code': '94041', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}     ip2location      (distance-2)
[IP_ADDRESS]            2001:4860:4802:32::15   AAAA    (distance-1, internal, ipv6, ptr-record, resolved)
[GEOLOCATION]           {'ip': '2001:4860:4802:0032:0000:0000:0000:0015', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.38605, 'longitude': -122.08385, 'zip_code': '94041', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}     ip2location      (distance-2)
[IP_ADDRESS]            2001:4860:4802:34::15   AAAA    (distance-1, internal, ipv6, ptr-record, resolved)
[GEOLOCATION]           {'ip': '2001:4860:4802:0034:0000:0000:0000:0015', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.38605, 'longitude': -122.08385, 'zip_code': '94041', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}     ip2location      (distance-2)
[IP_ADDRESS]            2607:f8b0:4004:c09::79  AAAA    (distance-1, internal, ipv6, ptr-record, resolved)
[GEOLOCATION]           {'ip': '2607:f8b0:4004:0c09:0000:0000:0000:0079', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'Virginia', 'city_name': 'Dulles', 'latitude': 38.951667, 'longitude': -77.448056, 'zip_code': '20102', 'time_zone': '-04:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}        ip2location   (distance-2)
[IP_ADDRESS]            142.251.163.121 A       (distance-1, internal, ipv4, ptr-record, resolved)
[GEOLOCATION]           {'ip': '142.251.163.121', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'California', 'city_name': 'Mountain View', 'latitude': 37.405992, 'longitude': -122.078515, 'zip_code': '94043', 'time_zone': '-07:00', 'asn': '15169', 'as': 'Google LLC', 'is_proxy': False}      ip2location     (distance-2)
[IP_ADDRESS]            69.178.14.215   A       (distance-1, internal, ipv4, ptr-record, resolved)
[GEOLOCATION]           {'ip': '69.178.14.215', 'country_code': 'US', 'country_name': 'United States of America', 'region_name': 'Alaska', 'city_name': 'Anchorage', 'latitude': 61.190395, 'longitude': -149.890405, 'zip_code': '99503', 'time_zone': '-08:00', 'asn': '8047', 'as': 'General Communication Inc.', 'is_proxy': False} ip2location     (distance-2)
[IP_ADDRESS]            2607:f8b0:4004:c09::79  AAAA    (distance-1, internal, ipv6, ptr-record, resolved)
[ASN]                   {"asn": "15169", "country": "US", "description": "Google LLC", "name": "GOOGLE", "subnet": "2607:f8b0:4004::/48"}       asn     (distance-2)
[IP_ADDRESS]            142.251.163.121 A       (distance-1, internal, ipv4, ptr-record, resolved)
[ASN]                   {"asn": "15169", "country": "US", "description": "Google LLC", "name": "GOOGLE", "subnet": "142.251.163.0/24"}  asn     (distance-2)
[IP_ADDRESS]            69.178.14.215   A       (distance-1, internal, ipv4, ptr-record, resolved)
[ASN]                   {"asn": "8047", "country": "US", "description": "GENERAL COMMUNICATION, INC.", "name": "GCI", "subnet": "69.178.0.0/17"}        asn     (distance-2)
[INFO] crobat: Query "honeybadger.page" failed (no response)
[PROTOCOL]              {"host": "honeybadger.page", "port": 80, "protocol": "HTTP"}    fingerprintx    (distance-0, in-scope, ip-216-239-38-21)
[PROTOCOL]              {"host": "honeybadger.page", "port": 443, "protocol": "HTTPS"}  fingerprintx    (distance-0, in-scope, ip-216-239-36-21)
[PROTOCOL]              {"host": "www.honeybadger.page", "port": 80, "protocol": "HTTP"}        fingerprintx    (distance-0, in-scope, ip-142-251-163-121)
[OPEN_TCP_PORT]         www.honeybadger.page:80 speculate       (distance-0, in-scope)
[OPEN_TCP_PORT]         www.honeybadger.page:443        speculate       (distance-0, in-scope)
[PROTOCOL]              {"host": "www.honeybadger.page", "port": 443, "protocol": "HTTPS"}      fingerprintx    (distance-0, in-scope, ip-142-251-163-121)
[URL]                   https://www.honeybadger.page/   httpx   (dir, distance-0, http-title-302-moved, in-scope, ip-142-251-163-121, status-302)
[URL]                   http://www.honeybadger.page/    httpx   (dir, distance-0, http-title-302-moved, in-scope, ip-142-251-163-121, status-302)
[INFO] Finishing scan
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | Affiliate         | Score   | Count   |
[INFO] affiliates: +===================+=========+=========+
[INFO] affiliates: | google.com        | 40.00   | 45      |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | googledomains.com | 29.50   | 30      |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | amazonaws.com     | 11.00   | 12      |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | windows.net       | 10.00   | 10      |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | vercel.app        | 9.50    | 10      |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | googleapis.com    | 8.50    | 9       |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | googlehosted.com  | 7.50    | 8       |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | 1e100.net         | 5.00    | 10      |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | gci.com           | 1.00    | 3       |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | gci.net           | 0.67    | 2       |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | vercel-infra.com  | 0.50    | 1       |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] affiliates: | invalid2.invalid  | 0.50    | 1       |
[INFO] affiliates: +-------------------+---------+---------+
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | Module              | Produced                        | Consumed                                |
[INFO] aggregate: +=====================+=================================+=========================================+
[INFO] aggregate: | ip2location         | 11 (11 GEOLOCATION)             | 11 (11 IP_ADDRESS)                      |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | A                   | 6 (6 IP_ADDRESS)                | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | speculate           | 5 (1 DNS_NAME, 4 OPEN_TCP_PORT) | 42 (18 DNS_NAME, 4 HTTP_RESPONSE, 11    |
[INFO] aggregate: |                     |                                 | IP_ADDRESS, 2 STORAGE_BUCKET, 4 URL, 3  |
[INFO] aggregate: |                     |                                 | URL_UNVERIFIED)                         |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | AAAA                | 5 (5 IP_ADDRESS)                | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | fingerprintx        | 4 (4 PROTOCOL)                  | 18 (18 OPEN_TCP_PORT)                   |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | httpx               | 4 (4 URL)                       | 18 (18 OPEN_TCP_PORT)                   |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | securitytrails      | 2 (2 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | azure_tenant        | 1 (1 AZURE_TENANT)              | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | binaryedge          | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | bucket_aws          | 1 (1 STORAGE_BUCKET)            | 4 (3 DNS_NAME, 1 STORAGE_BUCKET)        |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | bucket_gcp          | 1 (1 STORAGE_BUCKET)            | 4 (3 DNS_NAME, 1 STORAGE_BUCKET)        |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | c99                 | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | censys              | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | certspotter         | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | columbus            | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | crt                 | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | leakix              | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | otx                 | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | rapiddns            | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | shodan_dns          | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | virustotal          | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | wayback             | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | zoomeye             | 1 (1 DNS_NAME)                  | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | host                | 1 (1 DNS_NAME)                  | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | aws_cloud           | 1 (1 STORAGE_BUCKET)            | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | anubisdb            | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | azure_realm         | 0                               | 3 (3 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | bevigil             | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | bucket_azure        | 0                               | 3 (3 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | bucket_digitalocean | 0                               | 3 (3 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | bucket_firebase     | 0                               | 3 (3 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | crobat              | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | digitorus           | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | dnscommonsrv        | 0                               | 3 (3 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | dnsdumpster         | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | dnszonetransfer     | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | emailformat         | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | fullhunt            | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | github              | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | hackertarget        | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | hunterio            | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | myssl               | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | nsec                | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | oauth               | 0                               | 2 (1 DNS_NAME, 1 URL_UNVERIFIED)        |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | passivetotal        | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | pgp                 | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | riddler             | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | sitedossier         | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | skymem              | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | subdomain_hijack    | 0                               | 44 (43 DNS_NAME, 1 DNS_NAME_UNRESOLVED) |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | subdomaincenter     | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | sublist3r           | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | threatminer         | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | urlscan             | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | viewdns             | 0                               | 1 (1 DNS_NAME)                          |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | sslcert             | 0                               | 140 (140 OPEN_TCP_PORT)                 |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | MX                  | 0                               | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | NS                  | 0                               | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | TXT                 | 0                               | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | SOA                 | 0                               | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | PTR                 | 0                               | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | git                 | 0                               | 4 (4 URL)                               |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | iis_shortnames      | 0                               | 4 (4 URL)                               |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | robots              | 0                               | 4 (4 URL)                               |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | badsecrets          | 0                               | 4 (4 HTTP_RESPONSE)                     |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | filedownload        | 0                               | 7 (4 HTTP_RESPONSE, 3 URL_UNVERIFIED)   |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | hunt                | 0                               | 4 (4 HTTP_RESPONSE)                     |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | secretsdb           | 0                               | 4 (4 HTTP_RESPONSE)                     |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | wappalyzer          | 0                               | 4 (4 HTTP_RESPONSE)                     |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | excavate            | 0                               | 4 (4 HTTP_RESPONSE)                     |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | social              | 0                               | 3 (3 URL_UNVERIFIED)                    |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] aggregate: | CNAME               | 0                               | 0                                       |
[INFO] aggregate: +---------------------+---------------------------------+-----------------------------------------+
[INFO] asn: +---------+---------------------+--------------+--------+-----------------------------+-----------+
[INFO] asn: | ASN     | Subnet              | Host Count   | Name   | Description                 | Country   |
[INFO] asn: +=========+=====================+==============+========+=============================+===========+
[INFO] asn: | AS15169 | 216.239.32.0/19     | 10           | GOOGLE | Google LLC                  | US        |
[INFO] asn: +---------+---------------------+--------------+--------+-----------------------------+-----------+
[INFO] asn: | AS15169 | 2001:4860::/32      | 9            | GOOGLE | Google LLC                  | US        |
[INFO] asn: +---------+---------------------+--------------+--------+-----------------------------+-----------+
[INFO] asn: | AS15169 | 216.239.38.0/24     | 4            | GOOGLE | Google LLC                  | US        |
[INFO] asn: +---------+---------------------+--------------+--------+-----------------------------+-----------+
[INFO] asn: | AS15169 | 2607:f8b0:4004::/48 | 3            | GOOGLE | Google LLC                  | US        |
[INFO] asn: +---------+---------------------+--------------+--------+-----------------------------+-----------+
[INFO] asn: | AS15169 | 142.251.163.0/24    | 3            | GOOGLE | Google LLC                  | US        |
[INFO] asn: +---------+---------------------+--------------+--------+-----------------------------+-----------+
[INFO] asn: | AS8047  | 69.178.0.0/17       | 3            | GCI    | GENERAL COMMUNICATION, INC. | US        |
[INFO] asn: +---------+---------------------+--------------+--------+-----------------------------+-----------+
[INFO] gowitness: No web screenshots captured
[INFO] output.asset_inventory: +------------------+--------------+
[INFO] output.asset_inventory: | Domains          |              |
[INFO] output.asset_inventory: +==================+==============+
[INFO] output.asset_inventory: | honeybadger.page | 3/3 (100.0%) |
[INFO] output.asset_inventory: +------------------+--------------+
[INFO] output.asset_inventory: +----------------+-------------+
[INFO] output.asset_inventory: | IP Addresses   |             |
[INFO] output.asset_inventory: +================+=============+
[INFO] output.asset_inventory: | 216.239.0.0/16 | 1/3 (33.3%) |
[INFO] output.asset_inventory: +----------------+-------------+
[INFO] output.asset_inventory: | 69.178.0.0/16  | 1/3 (33.3%) |
[INFO] output.asset_inventory: +----------------+-------------+
[INFO] output.asset_inventory: | 142.251.0.0/16 | 1/3 (33.3%) |
[INFO] output.asset_inventory: +----------------+-------------+
[INFO] output.asset_inventory: +--------------+-------------+
[INFO] output.asset_inventory: | Open Ports   |             |
[INFO] output.asset_inventory: +==============+=============+
[INFO] output.asset_inventory: | 80           | 2/4 (50.0%) |
[INFO] output.asset_inventory: +--------------+-------------+
[INFO] output.asset_inventory: | 443          | 2/4 (50.0%) |
[INFO] output.asset_inventory: +--------------+-------------+
[INFO] output.asset_inventory: Saved asset-inventory output to /home/ubuntu/.bbot/scans/severe_travis/asset-inventory.csv
[INFO] output.csv: Saved CSV output to output.csv
[INFO] output.human: Saved TXT output to output.txt
[INFO] output.json: Saved JSON output to output.json
[INFO] output.subdomains: Saved subdomains to subdomains.txt
[INFO] output.web_report: Web Report saved to web_report.html
[SUCC] Scan severe_travis completed in 51 seconds with status FINISHED
[INFO] Saved word cloud (6 words) to /home/ubuntu/.bbot/scans/severe_travis/wordcloud.tsv

I'm also not sure why the config files are loaded multiple times. I noticed this started happening about a month ago I believe.

At this point I'm not sure what is causing the issue. I've also uploaded the debug.log file in case that helps.

debug.log

TheTechromancer commented 10 months ago

Thanks for the detailed report! This is not your fault; it's an aggravating bug that's been eluding me for some time. I will take a closer look and see if I can track it down.

TrustedSec sends their love 😘

Right back at you 😌🙏

TheTechromancer commented 10 months ago

Found it! This was a bug in passivetotal leftover from the async migration. A fix has been pushed: https://github.com/blacklanternsecurity/bbot/pull/831.

github-notafake-contact commented 10 months ago

You rock! Thanks