Set up a GCP image with initial state for FT benchmark

[akashin]

This is a follow-up to https://github.com/near/nearcore/issues/11359.

We now know how to generate the initial state but still need to start using it in the benchmarks. Concretely, I think we should follow the steps suggested in https://near.zulipchat.com/#narrow/stream/308695-nearone.2Fprivate/topic/Creating.20GCP.20disk.20image.20with.20initial.20NEAR.20state/near/445814332 for creating a new GCP image and then using this image in the Terraform configuration of CRT benchmark.

[akashin]

I finished generating a GCP disk and image with desired state, it is available at crt-benchmark-state-28-06-2024. Some useful stats for when we decide to repeat the state generation:

• It was fully generated on a single n2d-standard-16 instance in just under 40 hours.
• The command that I've used to generate it is:

  locust -H 127.0.0.1:3030 \
  -f locustfiles/ft.py \
  --funding-key=$KEY \
  --fixed-contract-names --num-ft-contracts=1 \
  --num-passive-users=5000000 \
  --max-workers=8 -u 1 -r 1 --headless --processes 8

• This creates 9 FT contracts, each with 5M of users and 625MB of state. In total, this gives 5.6GB of contract state and 45M users.
• The database size (data folder) takes 1.2TB on disk
• The generation is logged on Grafana: https://nearone.grafana.net/goto/La86B1QSR?orgId=1, https://nearone.grafana.net/goto/0siRL1QSg?orgId=1
• I used a modified genesis.json and config.json:
  • Changing gas limit to 5PGas
  • Disabling gas price changes under congestion
  • Setting transaction validity period to 1 day
  • Enabling memtrie

To use this state, one must use --fixed-contract-names, --num-ft-contracts=1 and --num-passive-users flags.

[akashin]

For the future record, here is how the shard size looks like: