search

GoogleCloudPlatform / appengine-gcs-client

App Engine-Cloud Storage custom client library
Apache License 2.0
124 stars 112 forks source link

Unable to upload to download large files #59

Open atalekar opened 7 years ago

atalekar commented 7 years ago

I realize that there is a 32 meg limit on response from app engine. What is the solution for an gae project to upload and download large files ? Can such an example be added to the python sample ?

rafaeldl commented 7 years ago

Same problem

BrandonY commented 7 years ago

Unfortunately, solutions here are tricky, given the hard cap. Your best bet might be to use a task queue, copying 32 megabytes at a time, then picking the transfer and enqueuing it for the next part of the transfer. That's a lot of effort to download an object, but it may be your best bet if your data needs to go through app engine.