blacklanternsecurity / bbot

A recursive internet scanner for hackers.
https://www.blacklanternsecurity.com/bbot/
GNU General Public License v3.0
4.02k stars 370 forks source link

Periodic dev merge #1448

Closed TheTechromancer closed 1 week ago

TheTechromancer commented 2 weeks ago

@domwhewell-sage when you get a chance would you mind looking at the trufflehog tests? The TestTrufflehog_NonVerified test is failing for me. I can't figure out why; the version hasn't changed, but it seems to be having trouble with the non-verified ones.

domwhewell-sage commented 2 weeks ago

Ah it appears truffle hog version 3.78.1 is no longer getting this unverified secret

~/.bbot/tools/trufflehog git file:///tmp/test_keys/
🐷🔑🐷  TruffleHog. Unearth your secrets. 🐷🔑🐷

2024-06-13T20:39:44+01:00       info-0  trufflehog      running source  {"source_manager_worker_id": "xpxBT", "with_units": true}
2024-06-13T20:39:44+01:00       info-0  trufflehog      scanning repo   {"source_manager_worker_id": "xpxBT", "unit": "/tmp/test_keys/", "unit_kind": "dir", "repo": "/tmp/test_keys/"}
✅ Found verified result 🐷🔑
Detector Type: URI
Decoder Type: PLAIN
Raw result: https://admin:admin@the-internet.herokuapp.com
Commit: 7e9ad4002a3fcd40298735a71d90e2ce521301f3
Email: BBOT Test <bbot@blacklanternsecurity.com>
File: keys.txt
Line: 2
Timestamp: 2024-06-13 18:20:06 +0000

2024-06-13T20:39:45+01:00       info-0  trufflehog      finished scanning       {"chunks": 2, "bytes": 236, "verified_secrets": 1, "unverified_secrets": 0, "scan_duration": "1.070352313s", "trufflehog_version": "3.78.1"}

Nothing has changed on our side but truffle hog automatically goes off and does a sneaky update unless you have the --no-update flag on

By rolling back the version on my machine and using this flag I was able to get the events to be emitted and the tests to pass

~/.bbot/tools/trufflehog --no-update git file:///tmp/test_keys/
🐷🔑🐷  TruffleHog. Unearth your secrets. 🐷🔑🐷

2024-06-13T20:37:22+01:00       info-0  trufflehog      running source  {"source_manager_worker_id": "Lfvfr", "with_units": true}
✅ Found verified result 🐷🔑
Detector Type: URI
Decoder Type: PLAIN
Raw result: https://admin:admin@the-internet.herokuapp.com
Commit: 7e9ad4002a3fcd40298735a71d90e2ce521301f3
Email: BBOT Test <bbot@blacklanternsecurity.com>
File: keys.txt
Line: 2
Timestamp: 2024-06-13 18:20:06 +0000

Found unverified result 🐷🔑❓
Verification issue: lookup internal.host.com on 172.29.64.1:53: no such host
Detector Type: URI
Decoder Type: PLAIN
Raw result: https://admin:admin@internal.host.com
Commit: 7e9ad4002a3fcd40298735a71d90e2ce521301f3
Email: BBOT Test <bbot@blacklanternsecurity.com>
File: keys.txt
Line: 5
Timestamp: 2024-06-13 18:20:06 +0000

2024-06-13T20:37:23+01:00       info-0  trufflehog      finished scanning       {"chunks": 2, "bytes": 236, "verified_secrets": 1, "unverified_secrets": 1, "scan_duration": "1.011314663s", "trufflehog_version": "3.75.1"}

So where to go from here...

TheTechromancer commented 2 weeks ago

Ah good catch!

codecov[bot] commented 1 week ago

Codecov Report

Attention: Patch coverage is 87.53310% with 565 lines in your changes missing coverage. Please review.

Project coverage is 92%. Comparing base (6e96b32) to head (ed37bc2). Report is 535 commits behind head on bbot-2.0.

Files Patch % Lines
bbot/core/helpers/dns/engine.py 77% 82 Missing :warning:
bbot/cli.py 66% 55 Missing :warning:
bbot/core/engine.py 79% 54 Missing :warning:
bbot/core/helpers/web/engine.py 78% 41 Missing :warning:
bbot/modules/portscan.py 78% 36 Missing :warning:
bbot/core/helpers/process.py 0% 34 Missing :warning:
bbot/modules/wpscan.py 82% 30 Missing :warning:
bbot/core/modules.py 88% 24 Missing :warning:
bbot/modules/base.py 83% 23 Missing :warning:
bbot/core/config/logger.py 89% 17 Missing :warning:
... and 50 more
Additional details and impacted files ```diff @@ Coverage Diff @@ ## bbot-2.0 #1448 +/- ## ========================================== - Coverage 92% 92% -0% ========================================== Files 321 346 +25 Lines 20553 23710 +3157 ========================================== + Hits 18892 21723 +2831 - Misses 1661 1987 +326 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.