search

Security-Tools-Alliance / rengine-ng

reNgine-ng is an automated reconnaissance framework for web applications with a focus on highly configurable streamlined recon process via Engines, recon data correlation and organization, continuous monitoring, backed by a database, and simple yet intuitive User Interface.
GNU General Public License v3.0
12 stars 6 forks source link

bug(scan): http_crawl fails with TypeError('can only join an iterable') #112

Closed psyray closed 2 weeks ago

psyray commented 2 weeks ago

Current Behavior

According to the latest modifications, under certain circumstance, there is a problem with the save_subdomain_metadata method image image

The HTTPx response does not contains any iterable data because of the error.

{
  "timestamp": "2024-06-19T13:25:14.213159887Z",
  "url": "",
  "input": "",
  "error": "context deadline exceeded (Client.Timeout exceeded while awaiting headers)",
  "words": 0,
  "lines": 0,
  "content_length": 0,
  "failed": true
}

A check need to be added to prevent this error

Expected Behavior

Http_crawl should run fine

Steps To Reproduce

Do a scan and maybe you could have the erreor if a request fails

Environment

- reNgine: 2.0.6
- OS: Debian
- Python: 3.10

Anything else?

No response

Acknowledgements