search

modxevil / google-cloud-sdk

Automatically exported from code.google.com/p/google-cloud-sdk
0 stars 0 forks source link

Errors were encountered while copying files to App Engine #321

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago 
What steps will reproduce the problem?
gcloud preview app deploy app.yaml --set-default --version 1

What is the expected output? What do you see instead?
I expect the application to be deployed to AppEngine, instead the "Updating 
module" step fails:

Beginning deployment...
Copying files to Google Cloud Storage...
Synchronizing files to [gs://staging.anti-fraud.appspot.com/].
Updating module [default]...failed.
ERROR: (gcloud.preview.app.deploy) Error Response: [13] Errors were encountered 
while copying files to App Engine.

What is the output of 'gcloud info'?

Please provide any additional information below.
This started yesterday morning, probably after a components update.

Details: [
  [
    {
      "@type": "type.googleapis.com/google.rpc.ResourceInfo",
      "description": "Failed to save static file.",
      "resourceName": "https://storage.googleapis.com/staging.anti-fraud.appspot.com/fda2d1e6ee25db93ac53ed86fe151eddca1a91f6",
      "resourceType": "file"
    },
    {
      "@type": "type.googleapis.com/google.rpc.ResourceInfo",
      "description": "Failed to save static file.",
      "resourceName": "https://storage.googleapis.com/staging.anti-fraud.appspot.com/96482c9dfcd84d52dfa4fba92101aac726cef4b6",
      "resourceType": "file"
    },
    {
      "@type": "type.googleapis.com/google.rpc.ResourceInfo",
      "description": "Failed to save static file.",
      "resourceName": "https://storage.googleapis.com/staging.anti-fraud.appspot.com/9697dcfa40a36f018526f5fd592a60004c0de2ce",
      "resourceType": "file"
    },
    {
      "@type": "type.googleapis.com/google.rpc.ResourceInfo",
      "description": "Failed to save static file.",
      "resourceName": "https://storage.googleapis.com/staging.anti-fraud.appspot.com/501122aa889dcc440a038a6841614c5821f5fa30",
      "resourceType": "file"
    }
  ]
]

Original issue reported on code.google.com by manuel.m...@gmail.com on 20 Oct 2015 at 3:27

GoogleCodeExporter commented 8 years ago 
Turning off the appengine api seems to fix the problem:

gcloud config set app/use_appengine_api false

Original comment by manuel.m...@gmail.com on 20 Oct 2015 at 11:51

GoogleCodeExporter commented 8 years ago 
Thanks for the report. We're looking into the issue.

Original comment by dlor...@google.com on 21 Oct 2015 at 4:44

GoogleCodeExporter commented 8 years ago 
Same problem here, I get tons of these kind of errors.

Original comment by stefano....@mmbsoftware.it on 27 Oct 2015 at 3:05

GoogleCodeExporter commented 8 years ago 
Hey Stefano, can you post the output of 'gcloud info'?

Are you running gcloud under a service account, by any chance?

Original comment by dlor...@google.com on 28 Oct 2015 at 9:13

GoogleCodeExporter commented 8 years ago 
I'm seeing this as well. app.yaml handlers look like this:

handlers:

- url: /demo/
  static_files: demo/index.html
  upload: demo/index.html
  secure: always

- url: /demo
  static_dir: demo
  secure: always

- url: /readme
  static_files: README.md
  upload: README.md
  secure: always

- url: .*
  script: handlers.app
  secure: always

gcloud info:

Google Cloud SDK [0.9.84]

Platform: [Mac OS X, x86_64]
Python Version: [2.7.10 (default, Jul 14 2015, 19:46:27)  [GCC 4.2.1 Compatible 
Apple LLVM 6.0 (clang-600.0.39)]]
Site Packages: [Disabled]

Installation Root: [/Users/ericbidelman/google-cloud-sdk]
Installed Components:
  core: [2015.10.23]
  app-engine-python: [1.9.27]
  core-nix: [2015.09.03]
  app-engine-java: [1.9.27]
  gcloud: [2015.10.23]
  gsutil-nix: [4.14]
  app-engine-php: [ ]
  gsutil: [4.15]
  bq: [2.0.18]
  app-engine-php-darwin: [2015.08.17]
  app: [2015.10.23]
  bq-nix: [2.0.18]
System PATH: 
[/Users/ericbidelman/google-cloud-sdk/bin:/Users/ericbidelman/.node/bin:/Users/e
ricbidelman/homebrew/bin:/Users/ericbidelman/projects/github/polymer/dev/tools/b
in:/Library/Frameworks/Python.framework/Versions/2.7/bin:/Library/Frameworks/Pyt
hon.framework/Versions/2.7/bin:/Library/Frameworks/Python.framework/Versions/Cur
rent/bin:/usr/local/git/current/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin
:/usr/sbin:/sbin:/opt/X11/bin:/Users/ericbidelman/projects/chrome/chromium-src/d
epot_tools:/Users/ericbidelman/projects/chrome/chromium/depot_tools:/Users/ericb
idelman/projects/go-code/bin:/Users/ericbidelman/.gem/ruby/2.2.0/bin]
Cloud SDK on PATH: [True]

WARNING: There are old versions of the Google Cloud Platform tools on your 
system PATH.
  /Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/dev_appserver.py

Installation Properties: [/Users/ericbidelman/google-cloud-sdk/properties]
User Config Directory: [/Users/ericbidelman/.config/gcloud]
User Properties: [/Users/ericbidelman/.config/gcloud/properties]
Current Workspace: [None]
Workspace Config Directory: [None]
Workspace Properties: [None]

Account: [ericbidelman@google.com]
Project: [io-staging]

Current Properties:
  [core]
    project: [io-staging]
    account: [ericbidelman@google.com]
    disable_usage_reporting: [False]
  [app]
    use_appengine_api: [True]
    suppress_change_warning: [true]

Original comment by ericbide...@google.com on 29 Oct 2015 at 2:27

GoogleCodeExporter commented 8 years ago 
The errors are like this one

    {
      "@type": "type.googleapis.com/google.rpc.ResourceInfo",
      "description": "Failed to save static file.",
      "resourceName": "https://storage.googleapis.com/staging.cloudmotive.appspot.com/b7dcb466bcd9f19d77e6f770bffbb24e0b94f644.js",
      "resourceType": "file"
    }

If I empty the staging bucket the first deploy works well, but from the second 
I get this kind of errors.

The "gcloud info":

Google Cloud SDK [0.9.84]

Platform: [Linux, x86_64]
Python Version: [2.7.6 (default, Jun 22 2015, 17:58:13)  [GCC 4.8.2]]
Site Packages: [Disabled]

Installation Root: [/var/lib/jenkins/google-cloud-sdk]
Installed Components:
  core: [2015.10.23]
  app-engine-python: [1.9.27]
  core-nix: [2015.09.03]
  kubectl: []
  app-engine-java: [1.9.27]
  gcloud: [2015.10.23]
  gsutil-nix: [4.14]
  beta: [2015.10.08]
  gsutil: [4.15]
  bq: [2.0.18]
  alpha: [2015.10.08]
  kubectl-linux-x86_64: [1.0.6]
  app: [2015.10.23]
  bq-nix: [2.0.18]
System PATH: 
[/var/lib/jenkins/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:
/usr/bin:/sbin:/bin:/usr/lib/jvm/java-8-oracle/bin:/usr/lib/jvm/java-8-oracle/db
/bin:/usr/lib/jvm/java-8-oracle/jre/bin:/var/lib/jenkins/appengine-java-sdk/bin/
]
Cloud SDK on PATH: [True]

Installation Properties: [/var/lib/jenkins/google-cloud-sdk/properties]
User Config Directory: [/var/lib/jenkins/.config/gcloud]
User Properties: [/var/lib/jenkins/.config/gcloud/properties]
Current Workspace: [None]
Workspace Config Directory: [None]
Workspace Properties: [None]

Account: [stefano.ciccarelli@mmbsoftware.it]
Project: [cloudmotive]

Current Properties:
  [core]
    project: [cloudmotive]
    account: [stefano.ciccarelli@mmbsoftware.it]
    disable_usage_reporting: [False]
  [app]
    use_appengine_api: [True]
    suppress_change_warning: [true]
  [compute]
    region: [us-central1]
    zone: [us-central1-c]

Logs Directory: [/var/lib/jenkins/.config/gcloud/logs]
Last Log File: 
[/var/lib/jenkins/.config/gcloud/logs/2015.10.29/09.10.34.062445.log]

I'm using my account to deploy and not a service one.

Original comment by stefano....@mmbsoftware.it on 29 Oct 2015 at 8:11

GoogleCodeExporter commented 8 years ago 
In case someone is reading this and is tempted to follow Stefano's reported 
workaround of "[emptying] the staging bucket", beware not to _delete_ the 
staging bucket as I just did :-( -- gcloud preview app deploy then fails when 
it cannot find that bucket and it doesn't seem possible to recreate it.

Original comment by deben...@gmail.com on 1 Nov 2015 at 11:13

GoogleCodeExporter commented 8 years ago 
Thanks for the info. We made some changes to reduce the frequency of this in 
the last release, but we're still chasing down some other sources of flakiness.

Original comment by dlor...@google.com on 3 Nov 2015 at 5:33

GoogleCodeExporter commented 8 years ago 
Is there anyway to recreate the staging bucket if I delete it?

Original comment by elli...@10kcoffees.com on 5 Nov 2015 at 2:55

GoogleCodeExporter commented 8 years ago 
Hey,

Not right now. We're working on automatically recreating it for you. In the 
meantime, you can create your own bucket and pass that to gcloud with the 
--bucket parameter to gcloud preview app deploy.

Original comment by dlor...@google.com on 5 Nov 2015 at 3:32

GoogleCodeExporter commented 8 years ago 
Still not working for me, even if I empty the bucket.

Google Cloud SDK [0.9.85]

Platform: [Linux, x86_64]
Python Version: [2.7.6 (default, Jun 22 2015, 17:58:13)  [GCC 4.8.2]]
Site Packages: [Disabled]

Installation Root: [/home/stefanoc/google-cloud-sdk]
Installed Components:
  core: [2015.10.30]
  app-engine-python: [1.9.28]
  core-nix: [2015.09.03]
  kubectl: []
  app-engine-java: [1.9.28]
  gcloud: [2015.10.30]
  gsutil-nix: [4.14]
  beta: [2015.10.08]
  gsutil: [4.15]
  bq: [2.0.18]
  alpha: [2015.10.08]
  kubectl-linux-x86_64: [1.0.6]
  app: [2015.10.30]
  bq-nix: [2.0.18]
System PATH: 
[/home/stefanoc/google-cloud-sdk/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/u
sr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/jvm/java-8-oracle/bin:/us
r/lib/jvm/java-8-oracle/db/bin:/usr/lib/jvm/java-8-oracle/jre/bin:/home/stefanoc
/appengine-java-sdk/bin/]
Cloud SDK on PATH: [True]

Installation Properties: [/home/stefanoc/google-cloud-sdk/properties]
User Config Directory: [/home/stefanoc/.config/gcloud]
User Properties: [/home/stefanoc/.config/gcloud/properties]
Current Workspace: [None]
Workspace Config Directory: [None]
Workspace Properties: [None]

Account: [stefano.ciccarelli@mmbsoftware.it]
Project: [cloudmotive]

Current Properties:
  [core]
    project: [cloudmotive]
    account: [stefano.ciccarelli@mmbsoftware.it]
    disable_usage_reporting: [False]
  [app]
    use_appengine_api: [True]
    suppress_change_warning: [true]
  [compute]
    region: [us-central1]
    zone: [us-central1-c]

Logs Directory: [/home/stefanoc/.config/gcloud/logs]
Last Log File: 
[/home/stefanoc/.config/gcloud/logs/2015.11.05/17.39.17.292417.log]

Original comment by stefano....@mmbsoftware.it on 5 Nov 2015 at 4:40

GoogleCodeExporter commented 8 years ago 
Ping to dlorenc@..

Original comment by rdayal@google.com on 20 Nov 2015 at 10:40

GoogleCodeExporter commented 8 years ago 
The "ERROR: (gcloud.preview.app.deploy) Error Response: [13] Errors were 
encountered while copying files to App Engine." issue should be fixed now. 
We're still tracking a fix to automatically recreate the bucket if it's been 
deleted.

Original comment by dlor...@google.com on 20 Nov 2015 at 10:42

GoogleCodeExporter commented 8 years ago 
Going to close this in favor of issue 379.

Original comment by z...@google.com on 20 Nov 2015 at 11:20