paleobiodb / data_service

The PBDB Data Service, API and table/system maintenance scripts
Artistic License 2.0
12 stars 0 forks source link

Slow response on /occs/taxa.json #28

Open jczaplew opened 7 years ago

jczaplew commented 7 years ago

In Rockd we use the following query to produce a list of nearby taxa:

https://paleobiodb.org/data1.2/occs/taxa.json?lngmax=-89.92494618509072&latmin=42.69286975940797&lngmin=-88.8895713169537&latmax=43.4492378004429&interval=Cambrian&idreso=lump_genus&rank=genus&show=class,img,classext

For a long time it was very fast, but now the request usually times out before it can be completed. It also is worth noting that in the above query (which I'm assuming got cached by MariaDB) the API reported the "elapsed time" as 0.2 seconds, even though the response took around 7 seconds.

Any thoughts as to what might be causing this?

Shane98c commented 7 years ago

Seeing similar issue at occs/list.json in Flyover

https://paleobiodb.org/data1.2/occs/list.json?base_name=dinosauria^aves&show=lag,eag,oid,tna,img,coords&loc=polygon((-107.34%2047.75,%20-103.44%2045.31,%20-99.85%2042.74,%20-96.35%2039.93,%20-92.96%2036.87,%20-89.15%2032.98,%20-88.88%2031.97,%20-89.04%2031.29,%20-89.44%2030.72,%20-90.38%2030.25,%20-91.08%2030.27,%20-91.72%2030.56,%20-96.22%2035.01,%20-100.41%2038.62,%20-104.65%2041.78,%20-109.66%2044.98,%20-110.08%2045.54,%20-110.26%2046.21,%20-110.16%2046.91,%20-109.81%2047.52,%20-109.25%2047.94,%20-108.57%2048.12,%20-107.88%2048.03,%20-107.34%2047.75))

jczaplew commented 7 years ago

Yesterday @mmcclenn indicated that the production server for PBDB was experiencing unusually high loads when I first reported this issue, and since then has responding to the original request quickly.

@Shane98c - have you noticed if that query is consistently slow for extended periods of time (a few days) or just periodically?

Shane98c commented 7 years ago

@jczaplew It does seem periodic, was just noticing it this morning but it seems alright now!

Edit: still slower than usual, it's the last of our requested datasets coming back and that isn't usually the case.