Packer build images failing DigitalOcean droplet snapshot creation with 504 gateway timeout errors ?

I've built out my Centmin Mod LEMP stack's DO droplet snapshot image building routines using Packer https://github.com/centminmod/centminmod-digitalocean-marketplace/tree/master/packer#using-build-imagesh-script for preparing images for DO Vendor Market Place submission but my last few runs of Packer had ended in errors at snapshot image creation stage in Packer with DO API returning 504 gateway timeout errors ? It seems to be a Cloudflare 504 returned error I suspect it's protecting the DO API and something isn't configured correctly and Cloudflare isn't getting a response back from DO API ?

Cloudflare reports 504 error with Ray ID: 4ccedc82ca4f9336

My commands to build a Centmin Mod LEMP stack image were

cd /root/tools/centminmod-digitalocean-marketplace/packer
git stash
git pull
./build-image-with-kernel-ml.sh 44955XXX s-1vcpu-1gb

which builds a CentOS 7 image via Packer using Droplet size = s-1vcpu-1gb which defaults to using Linux 5.0.x mainline kernel using a previously updated golden CentOS 7 snapshot image id = 44955XXX

starting output

packer validate packer-centos7-basic.json
Template validated successfully.

packer inspect packer-centos7-basic.json
Optional variables and their defaults:

  do_image               = centos-7-x64
  do_image_name          = centos7-packer-snapshot-php72-{{timestamp}}
  do_region              = sfo2
  do_size                = c-2
  do_tags                = cmm
  do_token               = {{env `TOKEN`}}
  enable_argon           = n
  enable_brotli          = n
  enable_dualcerts       = n
  enable_logrotate_zstd  = n
  enable_phpfpm_systemd  = n
  enable_phppgo          = n
  install_auditd         = n
  install_bbr            = n
  install_customcurl     = n
  install_docker         = n
  install_elrepo         = n
  install_go             = n
  install_mariadbtenfour = n
  install_mariadbtentwo  = n
  install_mongodb        = n
  install_newergit       = n
  install_nodejs         = n
  install_redis          = n

Builders:

  digitalocean

Provisioners:

  shell
  file
  file
  shell
  shell

Note: If your build names contain user variables or template
functions such as 'timestamp', these are processed at build time,
and therefore only show in their raw form here.

time TMPDIR=/home/packertmp PACKER_LOG=1 packer build -var do_image=44955XXX -var do_size=s-1vcpu-1gb -var do_region=sfo2 -var enable_argon=y -var 'install_elrepo=y' -var 'install_bbr=y' -var 'install_redis=y' -var 'enable_phpfpm_systemd=y' packer-centos7-basic.json
digitalocean output will be in this color.

==> digitalocean: Creating temporary ssh key for droplet...
==> digitalocean: Creating droplet...
==> digitalocean: Waiting for droplet to become active...
==> digitalocean: Using ssh communicator to connect: 167.99.xxx.xxx
==> digitalocean: Waiting for SSH to become available...
==> digitalocean: Connected to SSH!
==> digitalocean: Provisioning with shell script: /home/packertmp/packer-shell655352819
==> digitalocean: Uploading scripts/first-login.sh => /opt/centminmod/
1 items:  42.29 KiB / 42.29 KiB [=====================================================================================================================================================================================================================] 0s
==> digitalocean: Uploading scripts/01-setup-first-login.sh => /var/lib/cloud/scripts/per-instance/
1 items:  1.30 KiB / 1.30 KiB [=======================================================================================================================================================================================================================] 0s
==> digitalocean: Provisioning with shell script: /home/packertmp/packer-shell072918681
==> digitalocean: Provisioning with shell script: scripts/cmm-install.sh
    digitalocean: LETSENCRYPT_DETECT='y'
    digitalocean: SWITCH_PHPFPM_SYSTEMD='y'
    digitalocean: NGINX_VIDEO='y'
    digitalocean: PHPFINFO='y'
    digitalocean: PHP_LZFOUR='y'
    digitalocean: PHP_LZF='y'
    digitalocean: PHP_ARGON='y'
    digitalocean:
    digitalocean:
    digitalocean: hostname: packer-5cc15a71-b807-6db8-9b11-e82628f10fc1
    digitalocean:
    digitalocean: Architecture:          x86_64
    digitalocean: CPU op-mode(s):        32-bit, 64-bit
    digitalocean: Byte Order:            Little Endian
    digitalocean: CPU(s):                1
    digitalocean: On-line CPU(s) list:   0
    digitalocean: Thread(s) per core:    1
    digitalocean: Core(s) per socket:    1
    digitalocean: Socket(s):             1
    digitalocean: NUMA node(s):          1
    digitalocean: Vendor ID:             GenuineIntel
    digitalocean: CPU family:            6
    digitalocean: Model:                 63
    digitalocean: Model name:            Intel(R) Xeon(R) CPU E5-2650L v3 @ 1.80GHz
    digitalocean: Stepping:              2
    digitalocean: CPU MHz:               1799.998
    digitalocean: BogoMIPS:              3599.99
    digitalocean: Virtualization:        VT-x
    digitalocean: Hypervisor vendor:     KVM
    digitalocean: Virtualization type:   full
    digitalocean: L1d cache:             32K
    digitalocean: L1i cache:             32K
    digitalocean: L2 cache:              256K
    digitalocean: L3 cache:              30720K
    digitalocean: NUMA node0 CPU(s):     0
    digitalocean: Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl eagerfpu pni pclmulqdq vmx ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid xsaveopt

however when it comes time for Packer to shutdown the build droplet to create the resulting snapshot, it fails with DO API returning 504 gateway timeout

==> digitalocean: Gracefully shutting down droplet...
==> digitalocean: Creating snapshot: centos7-packer-snapshot-php72-1556175473
==> digitalocean: Waiting for snapshot to complete...
==> digitalocean: Error waiting for snapshot: GET https://api.digitalocean.com/v2/droplets/1414XXXXXX/actions/672746207: 504 <!DOCTYPE html>
==> digitalocean: <html>
==> digitalocean: <head>
==> digitalocean:   <title>DigitalOcean - Something went wrong!</title>
==> digitalocean:   <style type="text/css" >body{background-color:#fff;margin:0;padding:0;font-family:"Proxima Nova",Helvetica,sans-serif}h1{font-size:40px;color:#4b4b4b;font-weight:700;text-align:center;margin-top:0;margin-bottom:0;padding:0 10px}.sub-copy a{color:#474747;border-bottom:1px dotted #474747;text-decoration:none}.sub-copy{font-size:24px;font-weight:400;color:#3686be;line-height:1.5;max-width:800px;margin:0 auto;text-align:center;padding:15px 10px 0}.sammy{display:block;margin:0 auto;max-width:100%;position:relative;left:-50px}.header{background:#3686be;padding:40px}.header a,.header img{margin:0 auto;display:block}.waves{width:100%;height:100px;background-image:url(data:image/png;charset=binary;base64,iVBORw0KGgoAAAANSUhEUgAAAMgAAAEsCAMAAACxJAyMAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAAAyhpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tldCBiZWdpbj0i77u/IiBxE1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuNS1jMDIxIDc5LjE1NTc3MiwgMjAxNC8wMS8xMy0xOTo0NDowMCAgICAgICAgIj4gPHJkZjpSREYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMjIj4gPHJkZjpEZXNjcmlwdGlvbiByZGY6YWJvdXQ9IiIgeG1sbnM6eG1wPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bWxuczp4bXBNTT0iaHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL21tLyIgeG1sbnM6c3RSZWY9Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC9zVHlwZS9SZXNvdXJjZVJlZiMiIHhtcDpDcmVhdG9yVG9vbD0iQWRvYmUgUGhvdG9zaG9wIENDIDIwMTQgKE1hY2ludG9zaCkiIHhtcE1NOkluc3RhbmNlSUQ9InhtcC5paWQ6NzNBQTYyQTUzQzE4MTFFNEFBQjlFQjJBQ0U4QjgwREIiIHhtcE1NOkRvY3VtZW50SUQ9InhtcC5kaWQ6NzNBQTYyQTYzQzE4MTFFNEFBQjlFQjJBQ0U4QjgwREIiPiA8eG1wTU06RGVyaXZlZEZyb20gc3RSZWY6aW5zdGFuY2VJRD0ieG1wLmlpZDpFMzdBMDkxNjNCODQxMUU0QUFCOUVCMkFDRThCODBEQiIgc3RSZWY6ZG9jdW1lbnRJRD0ieG1wLmRpZDo3M0FBNjJBNDNDMTgxMUU0QUFCOUVCMkFDRThCODBEQiIvPiA8L3JkZjpEZXNjcmlwdGlvbj4gPC9yZGY6UkRGPiA8L3g6eG1wbWV0YT4gPD94cGFja2V0IGVuZD0iciI/Pj9AJwgAAAGPUExURf///zaGvjiHv2ymz9/s9f7//zeGvoq42cnf7ou52m+o0Pb5/EGNwrLQ5rPR5/3+/leayWGgzG2n0Pz9/vL3+16ey83h7zmIv3mu1DyKwLTS5/P4++vz+Xet04Gz1kqSxfn8/a3O5F2dylaZyFGWx8Ha62CfzN7r9NXm8U2UxUOOwpnB3jqIv9Dj8D6Lwe/2+sTb7GWizaPH4bfU6Pr8/cLa65bA3a7O5ez0+Ya22ICz1pfA3Y272pW/3T2KwGyn0JG9293r9IO110iRxGSizUWPw06VxsXc7Pb6/ESPw4e32Gmlz6zN5DuJwK/P5aXJ4lOYx1SYyHKq0anL4+30+dPk8crf7nCp0U+VxrbT6Mbd7UKNwlucytzq9Gqlz5nC3mOhzW6o0Hyw1UyTxaHH4drp85O+3Ojx+JG93J/F4Ony+PX5/MPb7ECMwb3X6l2ey/n7/ff6/PH2+n+y1bXS5+71+p3E38DZ64W119jn8ufx977Y6ubw93Or0lKXx8je7Y262qTI4lmbydfn8vj7/RBgL8EAAAITSURBVHja7NfVchRAFEXRZjQTd0+ICyHE3XB3d3d3d/hwXnmBiowF1vqDXbfqdHXY8I8IQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIESJEiBAhQoQIEbJuQxZ3HK2pqYhGe2rKux6tw5BdV68vTD3suz8efvf0/amJ9q2FXZH1EFI8kpwaHAp/9fNWyfbORP6GRC7OlMbiYZmeDy90JPIvZMvSvdqisFLTJccb8iikbuRKbVtYpQdjhZG8CDmbGi4Ka3Py5ucch2y+PBoL6RA/fSaRs5BNLx43hfS51HooFyH9qYKqkGZ37hZnOaRz7kc8ZMLQ7cXshTx5HQuZ05ysy0ZIZOeRjyHDegtDQUVmJ6qyvTlkR/xDecYe7pZz1SGLyhp3Z2JoZ988C9k2Xprmq2xMpn9ol3mViaVEmiISPQN98ZBDsdS+tVdcaCmdDjnXNlZYt5adrZirrQp54tXByoZVRXTMd1eH/LK3e+bGyv6pBwbON4X8FCt5+z2ynHWKzr/sLQv5rangRDLa/4eChmOVXw8PVof1o2jbl8Zvk/tn6z9Fo9fq61tTk6ONe941BwAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA/ge/BBgAc8GKsbXnyeIAAAAASUVORK5CYII=);background-size:100px 100px;background-repeat:repeat-x;opacity:1}.cf-error-details{max-width:800px;margin:40px auto 0;text-align:center}.cf-error-details p{max-width:600px;margin:20px auto 0}.cf-error-details ul{list-style-type:none;line-height:20px}</style>
==> digitalocean: 
==> digitalocean: 
==> digitalocean: </head>
==> digitalocean: 
==> digitalocean: <body>
==> digitalocean:   <div class="header">
==> digitalocean:     <a href="https://www.digitalocean.com"><img src="data:image/png; charset=binary;base64,iVBORw0KGgoAAAANSUhEUgAAALUAAAA0CAQAAABmtrFfAAAJ9UlEQVR4Ae3aCZDU1Z0H8E/PycDACOEajlEOERFFiZHDxDtxo1GUIJh4YhZX3F1TFdcjsqEi0VITNYvuuiqisaIkbvCKwu6yClEwiIDiAQgMhw4mJERhHO45ftv1r+mukWGEIcYqq/rzLaq73ntFz3z79b9ed0/K5yQnT06u6lzVObmqc1Xn5KrOVZ2rOidXda7qnL0VOGDRywiDddHgA29YZItWyCkIB6SrK11okBRgt9dN95jdcg5QKhyAy92um+beco2XfEZyVRe411UydqiRp5N8QJ1/MdVnIlf1gyaAHX5phuW2KdTdicY7GXClabjQSAFWul+r5aoe72GE37nDZqW2qrIF8F1TdUatEy32mIsA852klXInkG7uAlXa+I06a7xvow3mWKXBDG94Wl95fupUO2Rs12q5qi/REVT4yHhz1IACbQErDdddyE/nYA1UJiNUe99OWY5ylTdNF/ZlhO9a4AkH4jxjcbclMoodo592tlpphb+9aDl5sTQi8WgUhn3mnFgTq9P/bor/iIx5oRWZH001RFVMi0EhSWlUJqMXhX2kPKqT2VNCiPbRK9qEFjMlWTsmJCmJ62JtRNbS+E7426ZAy/oaDF5xmZZ01B/08LrZAilLpEA4ELWaSunl713iVj9BiXLQw76U6pCdLfSiY4w2W0v2gDrQ30xDNDXUDONcoubzvoAc6QzF3lQEfqxlAWhrejoZjzlBGGcZzjYJT/uZT3OdhSjQz1hnKjZFg1tt9k9u9LaH7UulG11hvqfQ07EK5TsQZWY7HNtM86Ityp3vIowy3djP8wIyIH4TdRGxJM6KSFsdhaHFjIvqJPeEJnk10mJkCDEhuf9waCFzk/nTQzY/SEbqYnBoluIoCPvISZEWpzVbnZ+9/6/JivNC3Jnc+yCODtmMil3J6NiQTVE6PpH8fXbRJlKhWVJ7r83zSaMsNUY+igFL1GrZM/rpq5+bNLXN7nTqQT2o9emKybrbE8h3I6aY60UVaGuSJTZY6zlXuczlhrnPXDNVmOQ2cIun0jkUQz3gHeut9pDeZO3R0USE8d4m61m3gEkKUej7XrEunZdcIQXO9pxK68x3Vba1k/3SKuu86+cOAfea50q9TLPaOv/tay3t6pGxOxKxIe6PAfFkfBz3hVanc/RMpyiE6BTHpnNYXBwTG3PkPnb1WaFJvpqMbYrieDa5NyCKYkHs7eHk1bM5vh6fdEzcEPWRFZXRLburT4tvJLdLwl7pHtURUR/9ol3Mi6ZmZF8JGU9EKvLTDTX1apSGWBIRH8WfI2NnHJ/Z3UI2RcnCiK1xdZSEJL1jZPgMUhAfRsbE/VbdMTYno31jRvLr94jLk9PJnTEwRsbCZOyOGBCLI+JP0TM9OztZ/59xdfxjdIwHI2J53BgXNz5VU7NVnxrXNK7ULK8lMyPijuR2UVwao2J6/DEuibHJyNw4I74Sd0dDRFwdeclP/lp8Py5rfGquDY0boiZuj0sbH/u5GN286nGNz8PXwmeQLtE7neLs9WxDZHxx/nw8qbU8pkfExsgLIUY1zok3k11dFuKmT1yrS2JE9kq5PiLeza44NX6c3N4WmmVOMnNDsinWRfuQpF2I1clrQ2NmRcTiEGUxLCTpGjURMbvx6Lo9hjZur/eS68NPmx/2xoB7zHew/t1xuNJyPO5U4RS/13pF2oJdgLAZHfSxFv1BHQLkoRi0Bey0EBQqscVh2iIANaBEc21Rb4hOeFoNYLv+DkO9yfIROqGnUtUWgWIldiht8uhrQZ3NKrK/iwKyBqLWNOW2qXEwjjcMZaCdAuTJKJKRb3/66Yqt/qAAFHvUP2tvlhm6uQJPW+nTHOt8p+uvgzYIGSmVYIi9lTkc26XAOrI6K8QAN5OVAiOMdrI+SjV9lJRCTVdF86rbYquNLjDnIKveAwKs1hG7lKBBWG4L4C/250r5mG+bQlBipQkedYSbUe8xE4WUlvzIzVJYm85gHcgqskitQica6nVNjdMVayxzIdqQtUNIecFkKRnVtrvPRLBKpaGKWvMWZguK5RtiqT85GFcoFdaA8WCUWVjg277u09SR9Q3fA/+GFKhT4hr5rve23Va0+NM1gJNMwTOutwYLDSer2CbPuEChB5ymRsYAt4AHLQfDyFprq47pLNTUOBPxkCmq5NmovDVf4y5GB8cr8XeaK0xnfyot86YdZLXVNcn+9FCRTh8nu91zivCIuTJ2GWKYlOH66+ubzlXhk1KgHdo7AdxlDXorb7buBh/ieL833mC9fdl1XtYFr3rEMu/jnMYOertZL7Mw1LVS4EQ/0c1whFtV4TiltGZX/8JVuNlM13vAdlBguNMc71Dt8bH1FnvBUvUOTL0G7LE/D2lASgHgERPIKvKuPyo3Oh1gh8nuIusDMNWP7PQAuNfjuvkH7e1tvXM9ravBHsYeRYBlxqhNZ7JfaON5L9rmVB2da4wzdXGny1Tq6QQM9H9IedSz+pugoLVvzGdGpP1XVMXcEB3jxlgV+7Iibouh4QBSGn2jInqEbPLTY5pkUezt9Safsv1vMtInvhzrY1csiMXp2arGzwCPircjYnd0CtE1VkTGt+KZyFgY05I3FRoPeReEJP0aP37IqImpURYaMylqI6Myzg4xIvP/J5bFiVEab0XGrPhVcsYWb0REbXQJISTtbYuHQgip0ERPcwzCbA8Z7Fpl2ObPqtUpdohuisl6zW89ZSXoop8NNtmXwVapBeQZaamdZJ2jp4yw1bveJOtMfTR4yQKd/cDPQYEfmpLMlSi306/tRmff0cOH5lmqjXEGqfWWmYpcZLfHHGcY/scGGUf6qgptbLPGyzZq6ihn6G6HFdkjQhvfdLQSWywzTy06uUA/Oy32vE7G2OS3Rim3y6/tAt/WxXbrvIK9qqaHp7zsefcaYJZnLVZlhwB0MMRZRhsgo948j5ilWncXqPCWRd6zG7RxmDOc5AFzBSgzwTMqtdYQy3CnyXaik6kuVm2gTV/s7xYLXJjOr7yss+FOcLgvKVKvWpV3vGqJj3zFpc7TXcYmT3rUYt1d4lu6q02nnc7yzTPJcsBoF7vbAq1XbI6T8IEqBQ5Xhonu54tddb90ipzrFN3t9JGP7dSgQFuH6Ky9Buu97Ekr9HV2OgNlLPdCckFpr4/u+IM3bAUDnO8sVSZb5+B8yWRj9AB1FviZ2Xyxq04lh6muVnjHRh9r0FShMuWOcJyj5XnJTO85yulOcZwKwB5vWGylTWqVOdQggx1iqXv8zl+nVB+d7PGB9+GLXnWeMtUa7F+JYw3ykfn+gmJ9DHSE/nrppoMCtWp8aKNVllpiC7m/A/FXqVCgSq2MlA7aKZavwW4fq9Fcruqc3N9X56rOyVWdqzpXdU6u6lzVObmqc1Xn5Kr+vP0/7Avj+KATCRMAAAAASUVORK5CYII="></a>
==> digitalocean:   </div>
==> digitalocean:   <div class="waves"></div>
==> digitalocean:   <div class="oops-copy">
==> digitalocean:     <h1>Looks like something went wrong...</h1>
==> digitalocean:     <p class="sub-copy">If this keeps happening, check out <a href="https://status.digitalocean.com/">status.digitalocean.com</a>.</p>
==> digitalocean:     <div class="cf-error-details cf-error-504">
==> digitalocean:   <h1>Gateway time-out</h1>
==> digitalocean:   <p>The web server reported a gateway time-out error.</p>
==> digitalocean:   <ul class="cferror_details">
==> digitalocean:     <li>Ray ID: 4ccedc82ca4f9336</li>
==> digitalocean:     <li>Your IP address: 159.65.xxx.xxx</li>
==> digitalocean:     <li>Error reference number: 504</li>
==> digitalocean:     <li>Cloudflare Location: San Jose</li>
==> digitalocean:   </ul>
==> digitalocean: </div>
==> digitalocean: 
==> digitalocean:   </div>
==> digitalocean: </body>
==> digitalocean: </html>
==> digitalocean: Destroying droplet...
==> digitalocean: Deleting temporary ssh key...
Build 'digitalocean' errored: Error waiting for snapshot: GET https://api.digitalocean.com/v2/droplets/1414XXXXXX/actions/672746207: 504 <!DOCTYPE html>

Part of the Packer build script routine is I inspect the droplet's IP geo data and looks like Cloudflare reported issue with Ray ID: 4ccedc82ca4f9336

==> digitalocean:   <div class="waves"></div>
==> digitalocean:   <div class="oops-copy">
==> digitalocean:     <h1>Looks like something went wrong...</h1>
==> digitalocean:     <p class="sub-copy">If this keeps happening, check out <a href="https://status.digitalocean.com/">status.digitalocean.com</a>.</p>
==> digitalocean:     <div class="cf-error-details cf-error-504">
==> digitalocean:   <h1>Gateway time-out</h1>
==> digitalocean:   <p>The web server reported a gateway time-out error.</p>
==> digitalocean:   <ul class="cferror_details">
==> digitalocean:     <li>Ray ID: 4ccedc82ca4f9336</li>
==> digitalocean:     <li>Your IP address: 159.65.xxx.xxx</li>
==> digitalocean:     <li>Error reference number: 504</li>
==> digitalocean:     <li>Cloudflare Location: San Jose</li>
==> digitalocean:   </ul>
==> digitalocean: </div>

I see status entry at https://status.digitalocean.com/incidents/m9b2g31t4g9z for 9hrs ago with DO API issues, but my issue is happening around 25 mins ago. Is it an DO API issue and/or a Cloudflare configuration issue for protected DO API ?

digitalocean / marketplace-partners

Packer build images failing DigitalOcean droplet snapshot creation with 504 gateway timeout errors ? #48