VertNet / webapp

VertNet web application
8 stars 7 forks source link

Timeout error breaks large downloads #486

Closed jotegui closed 10 years ago

jotegui commented 10 years ago

Large downloads, like "class:amphibia mappable:1" reach a timeout error and stop. Example output from logs:

Search failed. QUERY: class:amphibia mappable:1 ERROR: Failed to complete request in 9989ms Traceback (most recent call last): File "/base/data/home/apps/s~vertnet-portal/prod.376548070608441262/vertnet/service/search.py", line 77, in query results = search.Index(name=index_name, namespace=namespace).search(query) File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/datastore/datastore_rpc.py", line 103, in positional_wrapper return wrapped(_args, *_kwds) File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2798, in search _MakeSyncSearchServiceCall('Search', request, response, deadline) File "/base/data/home/runtimes/python27/python27_lib/versions/1/google/appengine/api/search/search.py", line 2989, in _MakeSyncSearchServiceCall raise _ToSearchError(e) Timeout: Failed to complete request in 9989ms

dbloom commented 10 years ago

To provide some context, this issue was raised by Pascal who attemped this query but never received a d/l link. I replicated the query in an attempt to see if I could get the dataset myself. The above was the result.

I realize that we very close to having those pre-packaged datasets for taxa, mappable or otherwise, but that won't solve this issue, and it certainly won't help others who have large datasets to download, but never receive them.

In the meantime, is there any other way to get this dataset from our index?

robgur commented 10 years ago

I am closing this issue and opening it as new issue thread