google / fuzzbench

FuzzBench - Fuzzer benchmarking as a service.
https://google.github.io/fuzzbench/
Apache License 2.0
1.1k stars 269 forks source link

Cloud Config: Missing `worker_pool_name` from experiment config template. #1805

Open mvanotti opened 1 year ago

mvanotti commented 1 year ago

I am trying to set up a cloud project for running my own experiment, and following the steps in "Running an experiment" they provide a sample experiment-config.

However, when I try to run it with a config derived from it, I get an error:

ERROR:root:Config does not contain required parameter "worker_pool_name".                                                                  

I made up a name for it, but I am not sure how to complete that.

DonggeLiu commented 1 year ago

Ah, sorry, it seems that the documentation is a bit outdated. Please refer to this example for the latest setting that we use to run experiments.

mvanotti commented 1 year ago

Thanks for the reply!

Are the worker pools something that needs to be configured? Do we need to do something besides enabling the worker pools api as instructed by the documentation?

mvanotti commented 1 year ago

It seems like private worker pools can be created from the gcloud console. One of the fields they specify is the virtual network. For now I am leaving it empty.

mvanotti commented 1 year ago

I made a bit of progress with this.

I was able to create the private worker pool (leaving virtual network details empty).

The project needs a cloud bucket to be created to store the cloud artifacts, that's not documented anywhere. The service account in GCE needs access to this workerpool, as well as "Viewer" role for the whole project (?????) in order for it to stream the logs for building.

It would be really nice if these steps were documented anywhere, as otherwise it is just trial an error reverse engineering each error u_u