search

sijocherian / google-bigquery

Automatically exported from code.google.com/p/google-bigquery
0 stars 0 forks source link

Query slow performance #182

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago 
We have noticed a slow down of query performance for about 4 weeks now. it is 
not consistent, sometimes the query is executed quite fast and sometimes it has 
to be abandoned but when submitted again, it would return results quick. This 
is independent of tale size being queried, for example, I had a simple query 
executing for over a minute   against one table of 30MB.

Original issue reported on code.google.com by moham...@maginteractive.se on 3 Nov 2014 at 2:59

GoogleCodeExporter commented 9 years ago 
This is an example of the issue:

SELECT userid, userid2 FROM [myData.test0] group each by userid, userid2 order 
by userid, userid2

Table test0 has 43 rows, 684KB

Query complete (63.2s elapsed, 688 B processed)

Original comment by moham...@maginteractive.se on 6 Nov 2014 at 5:23

GoogleCodeExporter commented 9 years ago 
Just checking, is caching in play as the cause of the fast runs?

Could you send a few fast and slow job_ids to look at?  And may I look for 
other runs of the same query text over time?

Original comment by e...@google.com on 19 Nov 2014 at 6:24

GoogleCodeExporter commented 9 years ago 
I am facing similar problems. My queries normally run in 6-8 seconds but 
randomly I am seeing queries that will not return after several minutes. For me 
this has become completely hit or miss, they either return in a normal amount 
of time or wont return at all (I am going through app engine so there is a 30s 
timeout).  

Here are a few fast running job ids:
- google.com:sampi:job_7tedpoRG6KJeqddibBj1VZ-hey0
- google.com:sampi:job_4F8ejyZUZUhgtcVgmH8_sLWxhc8
- google.com:sampi:job_YrpbY5aX9Hc9FQNrcpfIiC7sjNI

And some slow running job ids:
- google.com:sampi:job_YXV3xEpiwf_LDHo8MUTewVzi6PU
- google.com:sampi:job_4GRjz_vE-379bq4zb4SwSO4RErU

I ran all of there manually in the BigQuery UI and did not cache results. 

Please let me know if there is anything I can do to resolve this issue.

Original comment by rhollin...@google.com on 21 Nov 2014 at 9:28

GoogleCodeExporter commented 9 years ago 
No Caching is not.

Example of slow: -----------se-analytics:job_t3fxgx9l9P6War22jD9C3UZii4w

Original comment by moham...@maginteractive.se on 27 Nov 2014 at 2:12