search

SecurityRiskAdvisors / VECTR

VECTR is a tool that facilitates tracking of your red and blue team testing activities to measure detection and prevention capabilities across different attack scenarios
1.34k stars 156 forks source link

Automation Runtime timeout #226

Open dominyko opened 1 year ago

dominyko commented 1 year ago

I have imported hundreds of Atomic Red Teams tests and mapped them to different APT groups. Every time I try to Build Automation Runtime that consists of >200 tests, I get "Build timed out".

image

Macbook i9, 64gb ram =~ 185 tests Lenovo i7, 8gb ram =~ 100 tests

The time-out happens around ~1min mark. Is there a possibility of extending the time before it times out? Or any other workaround?

SRAPSpencer commented 1 year ago

Just wanted to memorialize this here, as it was discussed on the Discord.

  1. The build process is not happening on the browser end, your client will not be relevant.
  2. While the server running VECTR may be faster/slower on different hosts, it is likely a automation runtime of this size would ever complete with the current timeout window. This timeout window is currently not configurable.

Workaround: The EXE file is likely still being built, it's probably in the rta-builder container in the /builds/out directory. It won't be accessible via the UI. You can copy it out of the container from the Docker host machine.

The intent for using the automated execution framework to run test cases consistently and with some time savings. Bundling together large sets of test cases in automation would likely create noise in prevention and block events. For those reasons while we may make the timeout configurable in the future we are unlikely to directly spend development time on this approach to using the application.