Bug: New Sheets do not properly process Queries

[orwant]

What steps will reproduce the problem? Please provide a link to a
demonstration page if at all possible, or attach code.

Create a query based on the new spreadsheet URLs (ie "https://docs.google.com/spreadsheets/d/{key}/").
 Using a query in the form:

new Query('https://docs.google.com/spreadsheets/d/{key}/').send(responseHandler);

or the form:

new Query('https://docs.google.com/tq?key={key}').send(responseHandler);

the request is redirected to "https://docs.google.com/spreadsheets/d/{key}/tq?tqx=reqId:0"
which returns a 404 error.

What component is this issue related to (PieChart, LineChart, DataTable,
Query, etc)?
Query, Google Docs Spreadsheets

Are you using the test environment (version 1.1)?
(If you are not sure, answer NO)
No.

What operating system and browser are you using?
Windows 7 x64 Chrome

*********************************************************
For developers viewing this issue: please click the 'star' icon to be
notified of future changes, and to let us know how many of you are
interested in seeing it resolved.
*********************************************************

Original issue reported on code.google.com by drew_gallant@abtassoc.com on 2014-02-11 15:31:40

[orwant]

I would think this should be given some sort of priority, since Google has just made
the announcement that they're going to be migrating users over to the new spreadsheets
within the next few weeks. This is going to screw over anyone who uses the Google Visualization
API.

Original issue reported on code.google.com by donna.peplinskie@risevision.com on 2014-03-21 12:36:42

[orwant]

This is a major issue for us. We use this API daily to access our sheets.  When google
coverts us over to the new sheets we will be dead in the water.

Original issue reported on code.google.com by mark.kurley@globaldms.com on 2014-03-21 13:29:24

[orwant]

We use this service to power some of our internal, productivity tools and to provide
some services to our business users who use sheets for their business processes. If
this is not resolved soon, we will probably have to think about switching them and
us over to something else. Definitely a very high priority.

Original issue reported on code.google.com by NickTates on 2014-03-21 13:35:20

[orwant]

Hi everyone, it's a little hard to figure out whether this will fix it for all of you
without any specific links, but I was able to get the new trix spreadsheet working
by appending "gviz/tq" at the end, making the new URL "https://docs.google.com/spreadsheets/d/{key}/gviz/tq".
Please try that and let us know if this works. If it does not, please link to a failing
jsfiddle example. Thanks to everyone for your patience.

Original issue reported on code.google.com by grabks@google.com on 2014-03-21 14:26:52

[orwant]

That URL format does work for me.

A bit of background...the way we construct these URLs is by allowing the user to select
a spreadsheet using Google picker, then using the Spreadsheet Data API to retrieve
a list of worksheets. From there, we use the response in data.feed.entry[i].link[2].href
to construct the URL to that particular worksheet and pass that to the Visualization
API for data retrieval. Currently, the URL format that comes back from the Spreadsheet
Data API looks like this - https://spreadsheets.google.com/tq?key={key}
I'm assuming these URLs will continue to work after the migration?

So, having said that, I think there's a second related issue in that the href attribute
coming back from the Spreadsheet Data API is incorrect. It currently passes back a
URL like https://spreadsheets.google.com/spreadsheets/d/{key}/gviz/tq?gid=0, which
doesn't work with the Visualization API.

Thx.

Original issue reported on code.google.com by donna.peplinskie@risevision.com on 2014-03-21 15:14:28

[orwant]

To be clear, URLs from the Spreadsheet Data API for the old Google Sheets look like
this - https://spreadsheets.google.com/tq?key={key}&sheet=od6. I'd like to know if
these will continue to work even after the migration.

URLs from the Spreadsheet Data API for the new Google Sheets look like this - 
https://spreadsheets.google.com/spreadsheets/d/{key}/gviz/tq?gid=0 and these do NOT
work with the Google Visualization API.

Original issue reported on code.google.com by donna.peplinskie@risevision.com on 2014-03-21 15:22:25

[orwant]

It still doesn't work for me.
If I use the URL:
https://spreadsheets.google.com/tq?key=1chFDkz5Fqus1ODgtdEGNt4Mq2nxnkKnuqbEB4LaZF6o/gviz/tq

I have the following message in the browser:
google.visualization.Query.setResponse({"version":"0.6","status":"error","errors":[{"reason":"access_denied","message":"Access
denied","detailed_message":"Access denied"}]});

(the URL of the spreadsheet is 
https://docs.google.com/spreadsheets/d/1chFDkz5Fqus1ODgtdEGNt4Mq2nxnkKnuqbEB4LaZF6o/edit#gid=0)

Original issue reported on code.google.com by azzurroverde on 2014-03-22 16:07:51

[orwant]

I just noticed that you used:
https://docs.google.com/spreadsheets

while I used:
https://spreadsheets.google.com/spreadsheets

If I use docs.google.com it works.
Now I'm a little bit confused about using docs versus spreadsheets.

Original issue reported on code.google.com by azzurroverde on 2014-03-22 16:15:35

[orwant]

Similar to Donna, we NEED an answer on if URL's from the old Google speeds will continue
to work after the migration. To reiterate, here is Donna's question from above: 
URLs from the Spreadsheet Data API for the old Google Sheets look like this - https://spreadsheets.google.com/tq?key={key}&sheet=od6.
I'd like to know if these will continue to work even after the migration.

Does anyone have an answer for this?

Original issue reported on code.google.com by robb.price@risevision.com on 2014-03-28 14:59:30

[orwant]

FYI everybody, 

I spoke to Google Apps/Drive about this issue this morning, and this is what I was
told:

If the data URL is using the old sheet, it will always be there, therefore it will
always show up from that URL. Google is not going to force old sheets into new sheets.
This may change, but at the time, this is how it is. Even if you turn on new sheets
in Google Drive, your old ones, including the older API requests will still work.

The only problem will be if the people download a sheet, update and upload it as a
new sheet. . In that case, the older URL will not work. Also the older URL will not
work with new sheets, but we already know that.

Can someone from Google Visualization confirm this?

Thanks.

Original issue reported on code.google.com by robb.price@risevision.com on 2014-03-28 19:51:35

[orwant]

Hello there Google Visualization team, can I get an update or answer on this issue?

It is imperative that we know if the above information giving to us by the Google Apps/Drive
team is accurate.

Thanks.

Original issue reported on code.google.com by robb.price@risevision.com on 2014-04-07 15:10:10

[orwant]

Issue 1561 has been merged into this issue.

Original issue reported on code.google.com by grabks@google.com on 2014-04-15 13:46:42

[orwant]

As a workaround, I took an old spreadsheet and made a copy of it. Then I used importrange
formula to bring in data from a new spreadsheet and loaded it into Sheet1.

It brought the data in and the query worked perfectly.  The only issue with this system
is the delay in new data updating into the spreadsheet.

If Google doesn't modify old spreadsheets, this would solve everyone's problem until
the new spreadsheets work properly.

Original issue reported on code.google.com by garkin@appsolve.it on 2014-04-18 23:34:16

[orwant]

Issue 1555 has been merged into this issue.

Original issue reported on code.google.com by grabks@google.com on 2014-04-22 15:55:53

[orwant]

This issue is being looked into by the Google Docs team. I will update this issue when
it is resolved.

Original issue reported on code.google.com by grabks@google.com on 2014-04-22 15:59:31

[orwant]

Are you using the correct scope for OAuth? We has a similar problem and a colleague
fixed it by adding a new scope to the OAuth process: "https://docs.google.com/feeds",
our full scope now looks like:

"https://spreadsheets.google.com/feeds https://docs.google.com/feeds"

Original issue reported on code.google.com by michael@formstack.com on 2014-04-30 11:27:27

[orwant]

any solution?

google visualization and new spreadsheet are not compatible

tq parameter does not work with the new address https://docs.google.com/spreadsheets/d/{key}/gviz/tq?tq=select
A

Original issue reported on code.google.com by pivotView on 2014-04-30 14:54:27

[orwant]

This problem has more than one week, and is way too serious as the query language reference
does not support the new leaves of google 

example: 
new url https://docs.google.com/spreadsheets/d/1cnle5u7v-TGFInsFj_pooFWvwbti0NCL1anegCrltXU/gviz/tq?tq=select%20a

tq the parameter sel setQuery method does not work, the url does not have it in mind.

any solution?

Original issue reported on code.google.com by CristianG1026 on 2014-04-30 16:05:55

[orwant]

Hello everyone,

Unfortunately I don't have any updates for you guys or an estimate of when this will
be fixed, but rest assured that we are still aware of this problem and are working
towards a solution with the Docs team. We know that this is affecting a lot of users
and are working as fast as we can. I will post to this thread, issue #1476, and create
a new post when we have a solution or even a solid update.

Original issue reported on code.google.com by grabks@google.com on 2014-05-01 13:57:31

[orwant]

I am not sure if anyone is having success with this API and just getting a spreadsheet
back from a query, but I have been seeing issues with GData as well. The issue is not
with getting the spreadsheet, but with a query returning a 404 just for the spreadsheet's
underlying content, like worksheets, even though the URL is valid as per the specs.

Original issue reported on code.google.com by NickTates on 2014-05-02 13:54:34

[orwant]

@NickTates: The old query URL, the one in the documentation, does not work for the new
Sheets. As per this thread, you have to use a URL like https://docs.google.com/spreadsheets/d/{key}/gviz/tq
or https://docs.google.com/spreadsheets/d/{key}/edit to access the new Sheets via a
Query. If you are still having trouble with this, please create a publicly accessible
example that reproduces the issue, like a public-facing website, or a jsfiddle.

Original issue reported on code.google.com by grabks@google.com on 2014-05-02 13:57:59

[orwant]

Sure, I will try to get a fiddle together to help show this, but we are querying multiple
sheets at once and getting worksheets for each spreadsheet found, so we are not hitting
a specific sheet in a query.  I am also not sure if the Visualization api is having
this specific issue, I am seeing it just in GData now.

Original issue reported on code.google.com by NickTates on 2014-05-02 14:03:52

[orwant]

If you are seeing this issue in GData, then the GData support team will want to know
about it, so you should post to their issues list: https://code.google.com/p/gdata-issues/issues/list
to raise visibility.

If you do find an issue with the Visualization API (that is not already mentioned here),
then please let us know.

Original issue reported on code.google.com by grabks@google.com on 2014-05-02 14:12:23

[orwant]

I opened a ticket a few days ago (https://code.google.com/p/gdata-issues/issues/detail?id=6313&sort=-id&colspec=API%20ID%20Type%20Status%20Priority%20Stars%20Summary),
but I figured I would check and see if anyone knew of a similar issue with the visualization
api before I tried myself, especially since there are some issues already with the
new spreadsheets.

Original issue reported on code.google.com by NickTates on 2014-05-02 14:16:55

[orwant]

Hmm... It seems like the issue is related to using the new Sheets, but unrelated to
Google Charts. I'm not every experienced in the matters of Docs, but I think that the
GData API is old, and the Drive API is the new things that should be used. Here is
a link to their API reference: https://developers.google.com/drive/v2/reference/

Original issue reported on code.google.com by grabks@google.com on 2014-05-02 14:53:23

[orwant]

Any solution?
Visualization API and new spreadsheet doesn't work

Original issue reported on code.google.com by mtsjscsimdep on 2014-05-07 05:11:36

[orwant]

Nothing yet? this is something HUGE for me

Original issue reported on code.google.com by haroldo89 on 2014-05-14 03:44:32

[orwant]

Something has changed in recent weeks regarding the url query in the old
spreadsheets. We have some private google sites gadgets with url querys
like this
https://docs.google.com/a/mancoeduca.com/spreadsheet/pub?key=MYKEY&gid=0(published
spreadsheet)
Now are throwing access denied message. After change url to
https://docs.google.com/a/mancoeduca.com/spreadsheet/ccc?key=MYKEY&gid=0(without
publish) all working fine.

2014-05-14 5:44 GMT+02:00 <google-visualization-api-issues@googlecode.com>:

-- 
*José Alzueta*

Educación Ambiental
*Ingurumen Heziketarako Programa*
Mancomunidad de la Comarca de Pamplona
*Iruñerriko Mankomunitatea*

Original issue reported on code.google.com by jalzueta@mancoeduca.com on 2014-05-14 07:25:54

[orwant]

I stumbled upon this link (http://stackoverflow.com/questions/22695365/query-url-in-new-google-spreadsheet)
which shows that some selections are working if you use the 'range' parameter to define
selections e.g. ?range=X:X

This example selects the 2 columns specified:
https://docs.google.com/spreadsheets/d/1cnle5u7v-TGFInsFj_pooFWvwbti0NCL1anegCrltXU/gviz/tq?range=A:A,C:C

Original issue reported on code.google.com by fireflystats on 2014-05-15 07:55:15

[orwant]

I ve used 'range' parameter to define selections, but nothing new, the same issue 1476,
can not query with new spreadsheet URL https://docs.google.com/spreadsheets/d/mykey/gvis/tq

Original issue reported on code.google.com by mtsjscsimdep on 2014-05-16 09:01:12

[orwant]

I have a develop for a client, and it will stop working when spreadsheets change to
the new version, heeeelp!!!

Original issue reported on code.google.com by robe1984 on 2014-05-24 02:48:18

[orwant]

Hello there Google Visualization team, can I get an update or answer on this issue?

Original issue reported on code.google.com by riseqa50 on 2014-05-28 22:56:30

[orwant]

Issue 1562 has been merged into this issue.

Original issue reported on code.google.com by dlaliberte@google.com on 2014-05-29 13:56:53

[orwant]

Is there a current status you can share for this issue? 

Original issue reported on code.google.com by asc@risevision.com on 2014-05-29 14:34:49

[orwant]

We have no update at this time.  The issues involving the new spreadsheets are known
to the spreadsheets team.  We'll post updates here (and in related threads) when we
know more.

Original issue reported on code.google.com by dlaliberte@google.com on 2014-05-29 14:58:33

[orwant]

OK, can you give us an idea of whether you will continue to support the google charts
link to the spreadsheets or whether that feature will be discontinued / not supported?
 I find it hard to have faith in google products if I spend a lot of time building
out a tool using a feature that may or may not be discarded at a whim / with little
notice in the future.  At least telling us whether you plan to fix this or not will
give us some guidance on if we need to abandon this tool altogether or just continue
to wait and hope.  Also, it might be helpful to tell everyone that the old method still
available in your documentation ( https://developers.google.com/chart/interactive/docs/spreadsheets
) doesn't work.

Original issue reported on code.google.com by bslentz on 2014-05-29 15:54:27

[orwant]

It is our intention that existing links to existing spreadsheets that are used in charts
should continue to work.  

I am not certain about all the issues here, but my understanding is that the problems
involve new spreadsheets, including old spreadsheets converted into new spreadsheets.
 So if you create a chart that uses an old spreadsheet, perhaps it is safest to leave
that spreadsheet as is, and if you want to update it at some point, first copy it into
a new spreadsheet and reference it with the new url provided.

Original issue reported on code.google.com by dlaliberte@google.com on 2014-05-29 16:11:21

[orwant]

"It is our intention that *existing links* to *existing* spreadsheets that
are used in charts should continue to work."

Does this imply we should consider the query functionality deprecated for
new applications?

On 29 May 2014 17:11, <google-visualization-api-issues@googlecode.com>
wrote:

Original issue reported on code.google.com by fletcher.tom on 2014-05-29 16:19:54

[orwant]

Can anyone guide me on how to use the new Google Spreadsheets with Visualization API?
so that we can make necessary changes

Original issue reported on code.google.com by roopesh.naik on 2014-05-30 08:38:44

[orwant]

Google should require a degree in CFS, common freaking sense. . . . more than just the
query language.   Old scripts don't work either, they are replaced by the add-ons.
. . anyone remember when they broke tools for the script gallery, now the script gallery
is broken for add-ons, this is getting frustrating especially at the enterprise level.
 I have tried copying over the script sheets one by one, but the language is just not
supported.

Original issue reported on code.google.com by aaronthecarpenter on 2014-06-02 05:47:40

[orwant]

fletcher.tom: No, this means that existing links for old spreadsheets will continue
to work.

On that note, I am pleased to announce that queries have been fixed for the new Sheets.
We apologize for any inconvenience that this has caused, and will be happy to help
anyone who is still having issues. As before, new Sheets do use a new URL, but you
should simply be able to copy it from docs. A URL that looks like https://docs.google.com/spreadsheets/d/{key}/edit
should work. So should https://docs.google.com/spreadsheets/d/{key}/gviz/tq

Original issue reported on code.google.com by grabks@google.com on 2014-06-02 13:49:13

[orwant]

Awesome, thank you!

Original issue reported on code.google.com by romain.vialard on 2014-06-02 13:55:11

[orwant]

Thank you!
Some parameters like tqx=out:csv not working. Is there additional
information on request format that replace this
https://developers.google.com/chart/interactive/docs/dev/implementing_data_source
 ?

2014-06-02 15:55 GMT+02:00 <google-visualization-api-issues@googlecode.com>:

-- 
*José Alzueta*

Educación Ambiental
*Ingurumen Heziketarako Programa*
Mancomunidad de la Comarca de Pamplona
*Iruñerriko Mankomunitatea*

Original issue reported on code.google.com by jalzueta@mancoeduca.com on 2014-06-03 09:00:13

[orwant]

This still does not work get this error - Your client has issued a malformed or illegal
request

Original issue reported on code.google.com by roopesh.naik on 2014-06-04 05:30:58

[orwant]

We need more detail if we are going to help you. Is your spreadsheet
publicly accessible? What is the URL that you are trying to hit? Can you
create a new spreadsheet with dummy data and reproduce the error in a
jsfiddle?

On Wednesday, June 4, 2014, <google-visualization-api-issues@googlecode.com>
wrote:

Original issue reported on code.google.com by grabks@google.com on 2014-06-04 10:52:24

[orwant]

We are getting this error while accessing new spreadsheet URL 
"Sorry, the file you have requested does not exist."
Below is the url we are accessing 
https://docs.google.com/spreadsheets/d/1EiEf9ASVB1c0sOIz3n5AZgytOeTSc9ovnvRd2lSme4s/gviz/tq?tqx=out:html&tq=SELECT
A,B WHERE A CONTAINS '2013'
directly hitting from browser is success but output is json data , but accessing through
php code is resulting file not exist.

Original issue reported on code.google.com by shermiep on 2014-06-05 15:56:04

[orwant]

shermiep: There is currently still an issue where the tqx parameter is ignored when
you query new Sheets. I created an Issue to track this here: https://code.google.com/p/google-visualization-api-issues/issues/detail?id=1614

As for your other issue, about your PHP code giving you an error, that seems like it
is an issue with your PHP code not sending the correct request. The only other thing
that it could be is if Docs was depending on some cookie being set, or your user being
logged in, but you could easily verify that that's not the case by visiting your link
from an incognito window. If you post your PHP code, we can attempt to assist you.

Original issue reported on code.google.com by grabks@google.com on 2014-06-05 16:10:12

[orwant]

Thank You for quick response. I attached php code which calls visualization api. The
same code is working fine with old version spreadsheet. But new version spreadsheet
showing file not exist.

Original issue reported on code.google.com by shermiep on 2014-06-06 11:24:11

---

• Attachment: gspredsheet.php.txt

[orwant]

Are you sure that you are only using the new spreadsheet URL for the new
Sheets? If your target is an old spreadsheet, then the new URL won't work.
Likewise, if your target is a new spreadsheet, then the old URL won't work.
That's the only case I can think of that the spreadsheet would give you an
error. Maybe you need to convert your spreadsheets to the new Sheets?

On Friday, June 6, 2014, <google-visualization-api-issues@googlecode.com>
wrote:

Original issue reported on code.google.com by grabks@google.com on 2014-06-06 12:00:16

[orwant]

Thank You. We tried both old version and new version spreadsheets. For old version spreadsheet,
used below visualization api  url and is working fine
https://spreadsheets.google.com/tq?tqx=version:0.6;out:html&key={key}&tq={query}
For new version spreadsheet tried with 
https://docs.google.com/spreadsheets/d/{key}/gviz/tq?tqx=out:html&tq={query}
and returns file not exist. Please see updated code snippet.

Original issue reported on code.google.com by shermiep on 2014-06-09 09:46:42

---

• Attachment: gspreadsheet.php.txt