looker-open-source / gzr

A Command Line Tool for Looker Content Management
MIT License
122 stars 36 forks source link

Not able to take the content backup using gazer script when we upgraded looker to 21.xx.xx Version #97

Closed tamalampudi closed 2 years ago

tamalampudi commented 3 years ago

Hi Team,

using the gazer script we are not able to take the content backup like before , i mean older versions of looker, keep on getting "execution expired" error. :: Connection Failed. it was not the same case before upgrade. Script used : gzr space ls 1 --host='xxxxxx.cloud.looker.com' --port='443' --client-id=xxxxxx --client-secret=xxxxx gzr space ls 1 --host='xxxxxx.cloud.looker.com' --port='443' --client-id=xxxxxx --client-secret=xxxxxx gzr space ls 1 --host='xxxxxx.cloud.looker.com' --port='443' --client-id=xxxxxx --client-secret=xxxxx gzr space ls 2 --host='xxxxxx.cloud.looker.com' --port='443' --client-id=xxxxx --client-secret=xxxxx gzr space ls 2 --host='xxxxxx.cloud.looker.com' --port='443' --client-id=xxxxxx --client-secret=xxxxxx gzr space ls 2 --host='xxxxxx.cloud.looker.com' --port='443' --client-id=xxxxxx --client-secret=xxxxxx

Thanks

tamalampudi commented 3 years ago

(base) SIVANARAYANA.TAMALAMPUDI@sivanarpudismbp ContentBackupOct012021 % gzr space export 1 --host='xxxxxxxxx.cloud.looker.com' --port='443' --client-id='xxxxxx' --client-secret='xxxxxx'

The color_collection(bdo) is not found The color_collection(bdo) is not found The color_collection(bdo) is not found The color_collection(306fbe33-6921-4f0a-858c-5a679bc1bf08) is not found The color_collection(306fbe33-6921-4f0a-858c-5a679bc1bf08) is not found The color_collection(306fbe33-6921-4f0a-858c-5a679bc1bf08) is not found The color_collection(306fbe33-6921-4f0a-858c-5a679bc1bf08) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found The color_collection(592616d0-58e4-4968-9030-928ef38b7b50) is not found Traceback (most recent call last): 51: from /usr/local/bin/gzr:23:in <main>' 50: from /usr/local/bin/gzr:23:inload' 49: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/exe/gzr:36:in <top (required)>' 48: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:instart' 47: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in dispatch' 46: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:ininvoke_command' 45: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in run' 44: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:238:inblock in subcommand' 43: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:115:in invoke' 42: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:indispatch' 41: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in invoke_command' 40: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:inrun' 39: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space.rb:80:in export' 38: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:49:inexecute' 37: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/session.rb:207:in with_session' 36: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:81:inblock in execute' 35: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in process_space' 34: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:ineach' 33: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:in block in process_space' 32: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:inprocess_space' 31: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in each' 30: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:inblock in process_space' 29: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:in process_space' 28: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:ineach' 27: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:110:in block in process_space' 26: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/dashboard.rb:29:inquery_dashboard' 25: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:106:in method_missing' 24: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:139:ininvoke_remote' 23: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:96:in get' 22: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:304:inrequest' 21: from /Library/Ruby/Gems/2.6.0/gems/sawyer-0.8.2/lib/sawyer/agent.rb:94:in call' 20: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:138:inget' 19: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:387:in run_request' 18: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/rack_builder.rb:143:inbuild_response' 17: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/response.rb:8:in call' 16: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:38:incall' 15: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:92:in with_net_http_connection' 14: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:43:inblock in call' 13: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:85:in perform_request' 12: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1228:inget' 11: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1470:in request' 10: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:920:instart' 9: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1472:in block in request' 8: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1479:inrequest' 7: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:in transport_request' 6: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:incatch' 5: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1509:in block in transport_request' 4: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:29:inread_new' 3: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:40:in read_status_line' 2: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:201:inreadline' 1: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:191:in readuntil' /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:217:inrbuf_fill': Net::ReadTimeout with #<TCPSocket:(closed)> (Net::ReadTimeout) 51: from /usr/local/bin/gzr:23:in <main>' 50: from /usr/local/bin/gzr:23:inload' 49: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/exe/gzr:36:in <top (required)>' 48: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:instart' 47: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in dispatch' 46: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:ininvoke_command' 45: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in run' 44: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:238:inblock in subcommand' 43: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:115:in invoke' 42: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:indispatch' 41: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in invoke_command' 40: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:inrun' 39: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space.rb:80:in export' 38: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:49:inexecute' 37: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/session.rb:207:in with_session' 36: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:81:inblock in execute' 35: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in process_space' 34: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:ineach' 33: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:in block in process_space' 32: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:inprocess_space' 31: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in each' 30: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:inblock in process_space' 29: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:in process_space' 28: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:ineach' 27: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:110:in block in process_space' 26: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/dashboard.rb:29:inquery_dashboard' 25: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:106:in method_missing' 24: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:139:ininvoke_remote' 23: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:96:in get' 22: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:304:inrequest' 21: from /Library/Ruby/Gems/2.6.0/gems/sawyer-0.8.2/lib/sawyer/agent.rb:94:in call' 20: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:138:inget' 19: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:387:in run_request' 18: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/rack_builder.rb:143:inbuild_response' 17: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/response.rb:8:in call' 16: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:38:incall' 15: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:92:in with_net_http_connection' 14: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:43:inblock in call' 13: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:85:in perform_request' 12: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1228:inget' 11: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1470:in request' 10: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:920:instart' 9: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1472:in block in request' 8: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1479:inrequest' 7: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:in transport_request' 6: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:incatch' 5: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1509:in block in transport_request' 4: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:29:inread_new' 3: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:40:in read_status_line' 2: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:201:inreadline' 1: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:191:in readuntil' /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:217:inrbuf_fill': Net::ReadTimeout with #<TCPSocket:(closed)> (Faraday::TimeoutError)

KGoodacre commented 3 years ago

The issue is that we use Gazer to backup our company's spaces (Shared & Personal/Users) to a Git Repository.

We are using a cloud Looker server and every time we use the "gzr space export" command we receive a timeout error. The timeout error is thrown inconsistently; sometimes it occurs seconds after issuing the command, and sometimes it takes an hour before throwing the timeout error.

We've tried many workarounds such as:

  1. Increasing the timeout amount.
  2. Increasing the timeout to a ridiculous amount 70k+.
  3. Splitting the export space job into smaller sections (using the individual child space ids instead of the parent id 1 or 2).
  4. Updating ruby & packages dependencies to use the latest.
  5. Having several people run the command using different combinations of package versions.

Nothing seems to work, we run into the same error every time.

@drstrangelooker @ajcrutch Could you please assist us in a workaround for this issue? It is very critical.

USAGE: "gzr space export" to convert each space and it's folder structure into json files. Then we push to Git, this is done once a day for spaces 1 & 2, in order to create a backup source. --> This is done through a TeamCity build

EXAMPLE OF ERROR: ` /usr/lib/ruby/2.5.0/net/http.rb:939:in `rescue in block in connect': Failed to open TCP connection to companystaging.cloud.looker.com:443 (getaddrinfo: Name or service not known) (Faraday::ConnectionFailed) from /usr/lib/ruby/2.5.0/net/http.rb:936:in `block in connect' from /usr/lib/ruby/2.5.0/timeout.rb:93:in `block in timeout' from /usr/lib/ruby/2.5.0/timeout.rb:103:in `timeout' from /usr/lib/ruby/2.5.0/net/http.rb:935:in `connect' from /usr/lib/ruby/2.5.0/net/http.rb:920:in `do_start' from /usr/lib/ruby/2.5.0/net/http.rb:909:in `start' from /usr/lib/ruby/2.5.0/net/http.rb:1458:in `request' from /usr/lib/ruby/2.5.0/net/http.rb:1216:in `get' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/adapter/net_http.rb:86:in `perform_request' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/adapter/net_http.rb:44:in `block in call' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/adapter/net_http.rb:93:in `with_net_http_connection' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/adapter/net_http.rb:39:in `call' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/response.rb:8:in `call' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/rack_builder.rb:143:in `build_response' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/connection.rb:387:in `run_request' from /var/lib/gems/2.5.0/gems/faraday-0.17.4/lib/faraday/connection.rb:138:in `get' from /var/lib/gems/2.5.0/gems/sawyer-0.8.2/lib/sawyer/agent.rb:94:in `call' from /var/lib/gems/2.5.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:304:in `request' from /var/lib/gems/2.5.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:96:in `get' from /var/lib/gems/2.5.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:139:in `invoke_remote' from /var/lib/gems/2.5.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:106:in `method_missing' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/modules/dashboard.rb:29:in `query_dashboard' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:110:in `block in process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:in `each' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:in `process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:in `block in process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in `each' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in `process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:in `block in process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in `each' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in `process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:in `block in process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in `each' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in `process_space' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:81:in `block in execute' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/modules/session.rb:207:in `with_session' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:49:in `execute' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/lib/gzr/commands/space.rb:80:in `export' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor/command.rb:27:in `run' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in `invoke_command' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor.rb:387:in `dispatch' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor/invocation.rb:115:in `invoke' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor.rb:238:in `block in subcommand' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor/command.rb:27:in `run' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in `invoke_command' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor.rb:387:in `dispatch' from /var/lib/gems/2.5.0/gems/thor-0.20.3/lib/thor/base.rb:466:in `start' from /var/lib/gems/2.5.0/gems/gazer-0.2.44/exe/gzr:36:in `' from /usr/local/bin/gzr:23:in `load' from /usr/local/bin/gzr:23:in `
' Process exited with code 1`

https://github.com/looker-open-source/gzr/issues/84#issuecomment-942782970

vpoiesz commented 3 years ago

Hi @KGoodacre , just to clarify, are you and @tamalampudi working for the same company and thus addressing the same core problem? It looks like the first error message is a timeout, whereas the one you posted suggests a DNS issue (getaddrinfo: Name or service not known). Were these run on the same version of Looker and Gazer? From the same client machine?

Can you please clarify which exact Looker version you were successfully using previously, and which one you are using now? "21.xx" is a rather broad range for us.

In any case, given the various solutions you tried already it does seem like a networking problem. To start, please double check your API host url as per the documentation here. This value might have changed recently if your Looker instance was migrated to new hosting infrastructure. Our chat support team can help you verify the correct API host URL as well.

Once we have that settled, let's take Gazer out of the equation and attempt some simple API calls from the command line using curl. This doc is a good reference. So the first command would look something like:

curl -i https://<your-api-host-and-port>/alive

Then we can try a login with the same client_id and client_secret used for Gazer:

curl -i  -d "client_id=xxxxxx&client_secret=xxxxxx"  https://<your-api-host-and-port>/login

If those commands fail then we'll know the issue is with networking or the API host url. If they succeed then we'll know it is something in Gazer. Please let me know how it goes!

tamalampudi commented 3 years ago

Hi Victor,

Greetings!!

Kenyian and I work for the same company, and we are discussing on the same issue.

As informed before, there is no issue for the same script when we use 7.20 looker version, when we upgraded to 21.xx then only issue started intermittently then when we keep on upgrading the 21.xx to latest we keep on getting the timeout error what Kenyian mention in it.

As you suggested I tried the curl command its working as expected, I can be able to connect without issues

Example :

curl -d "client_id=xxxxxxxxxx&client_secret=xxxxxxxxxx" https://xpologisticsprod.cloud.looker.com:443/api/3.1/login

[signature_955909060] SIVANARAYANA REDDY TAMALAMPUDI Less-Than-Truckload Lead System Admin, Business Intelligence

XPOLogistics 2211 Old Earhart Road Ann Arbor, MI 48105, USA O: +1 734-757-1426 M: +1 734-210-9286 PTO: None.

From: Victor Poiesz @.> Date: Wednesday, October 13, 2021 at 8:10 PM To: looker-open-source/gzr @.> Cc: Sivanarayana Tamalampudi @.>, Mention @.> Subject: Re: [looker-open-source/gzr] Not able to take the content backup using gazer script when we upgraded looker to 21.xx.xx Version (#97) [Warning: External sender, “Report Phish” for suspicious emails]

Hi @KGoodacrehttps://urldefense.com/v3/__https:/github.com/KGoodacre__;!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFselnGSaA$ , just to clarify, are you and @tamalampudihttps://urldefense.com/v3/__https:/github.com/tamalampudi__;!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFtwIzjAfA$ working for the same company and thus addressing the same core problem? It looks like the first error message is a timeout, whereas the one you posted suggests a DNS issue (getaddrinfo: Name or service not known). Were these run on the same version of Looker and Gazer? From the same client machine?

Can you please clarify which exact Looker version you were successfully using previously, and which one you are using now? "21.xx" is a rather broad range for us.

In any case, given the various solutions you tried already it does seem like a networking problem. To start, please double check your API host url as per the documentation herehttps://urldefense.com/v3/__https:/docs.looker.com/admin-options/platform/api__;!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFtc1EuENw$. This value might have changed recently if your Looker instance was migrated to new hosting infrastructure. Our chat support team can help you verify the correct API host URL as well.

Once we have that settled, let's take Gazer out of the equation and attempt some simple API calls from the command line using curl. This dochttps://urldefense.com/v3/__https:/github.com/looker/looker-sdk-ruby/blob/master/authentication.md__;!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFu_XtUNBw$ is a good reference. So the first command would look something like:

curl -i https:///alivehttps://urldefense.com/v3/__https:/*3Cyour-api-host-and-port*3E/alive__;JSU!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFtNFHKTjQ$

Then we can try a login with the same client_id and client_secret used for Gazer:

curl -i -d "client_id=xxxxxx&client_secret=xxxxxx" https:///loginhttps://urldefense.com/v3/__https:/*3Cyour-api-host-and-port*3E/login__;JSU!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFtZSUuREw$

If those commands fail then we'll know the issue is with networking or the API host url. If they succeed then we'll know it is something in Gazer. Please let me know how it goes!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHubhttps://urldefense.com/v3/__https:/github.com/looker-open-source/gzr/issues/97*issuecomment-942812307__;Iw!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFsSVfLaAQ$, or unsubscribehttps://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/AJXKASYAH7Y7PZYP57CSC73UGYNXPANCNFSM5FMHQKKQ__;!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFvFROZpqg$. Triage notifications on the go with GitHub Mobile for iOShttps://urldefense.com/v3/__https:/apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675__;!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFs7DXJHig$ or Androidhttps://urldefense.com/v3/__https:/play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign*3Dnotification-email*26utm_medium*3Demail*26utm_source*3Dgithub__;JSUlJSU!!Lw3mCg!VjMgGR_AuhGR8OqmAmlsG8tfyZmlfeNr_8Kpts0QulRjtM0MejV6iXROwHN8vAgjnFtWJR-n0Q$.

[Do not open attachments or click links unless you can verify the sender. Click “Report Phishing” if the email looks suspicious.]

tamalampudi commented 2 years ago

When i try to take the shared content backup through below command i am getting error: gzr space export 1 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxxxxx' --client-secret='xxxxxxxx'

error:

The color_collection(bdo) is not found The color_collection(bdo) is not found The color_collection(bdo) is not found Traceback (most recent call last): 63: from /usr/local/bin/gzr:23:in <main>' 62: from /usr/local/bin/gzr:23:inload' 61: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/exe/gzr:36:in <top (required)>' 60: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:instart' 59: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in dispatch' 58: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:ininvoke_command' 57: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in run' 56: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:238:inblock in subcommand' 55: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:115:in invoke' 54: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:indispatch' 53: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in invoke_command' 52: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:inrun' 51: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space.rb:80:in export' 50: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:49:inexecute' 49: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/session.rb:207:in with_session' 48: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:81:inblock in execute' 47: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in process_space' 46: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:ineach' 45: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:in block in process_space' 44: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:inprocess_space' 43: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:in each' 42: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:111:inblock in process_space' 41: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:111:in each_index' 40: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:113:inblock (2 levels) in process_space' 39: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:in find_vis_config_reference' 38: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:ineach' 37: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:in block in find_vis_config_reference' 36: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:infind_vis_config_reference' 35: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:in each' 34: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:inblock in find_vis_config_reference' 33: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:171:in find_vis_config_reference' 32: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:114:inblock (3 levels) in process_space' 31: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:in find_color_palette_reference' 30: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:ineach' 29: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:in block in find_color_palette_reference' 28: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:infind_color_palette_reference' 27: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:in each' 26: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:inblock in find_color_palette_reference' 25: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:189:in find_color_palette_reference' 24: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:115:inblock (4 levels) in process_space' 23: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:215:in rewrite_color_palette!' 22: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:156:incolor_collection' 21: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:106:in method_missing' 20: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:139:ininvoke_remote' 19: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:96:in get' 18: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:304:inrequest' 17: from /Library/Ruby/Gems/2.6.0/gems/sawyer-0.8.2/lib/sawyer/agent.rb:94:in call' 16: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:138:inget' 15: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:387:in run_request' 14: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/rack_builder.rb:143:inbuild_response' 13: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/response.rb:8:in call' 12: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:38:incall' 11: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:92:in with_net_http_connection' 10: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:43:inblock in call' 9: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:85:in perform_request' 8: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1228:inget' 7: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1470:in request' 6: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:919:instart' 5: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:930:in do_start' 4: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:945:inconnect' 3: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/timeout.rb:103:in timeout' 2: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:947:inblock in connect' 1: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:947:in open' /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:947:ininitialize': execution expired (Net::OpenTimeout) 63: from /usr/local/bin/gzr:23:in <main>' 62: from /usr/local/bin/gzr:23:inload' 61: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/exe/gzr:36:in <top (required)>' 60: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:instart' 59: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in dispatch' 58: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:ininvoke_command' 57: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in run' 56: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:238:inblock in subcommand' 55: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:115:in invoke' 54: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:indispatch' 53: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in invoke_command' 52: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:inrun' 51: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space.rb:80:in export' 50: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:49:inexecute' 49: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/session.rb:207:in with_session' 48: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:81:inblock in execute' 47: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:in process_space' 46: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:137:ineach' 45: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:138:in block in process_space' 44: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:inprocess_space' 43: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:109:in each' 42: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:111:inblock in process_space' 41: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:111:in each_index' 40: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:113:inblock (2 levels) in process_space' 39: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:in find_vis_config_reference' 38: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:ineach' 37: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:in block in find_vis_config_reference' 36: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:infind_vis_config_reference' 35: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:in each' 34: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:173:inblock in find_vis_config_reference' 33: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:171:in find_vis_config_reference' 32: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:114:inblock (3 levels) in process_space' 31: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:in find_color_palette_reference' 30: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:ineach' 29: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:in block in find_color_palette_reference' 28: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:infind_color_palette_reference' 27: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:in each' 26: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:191:inblock in find_color_palette_reference' 25: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:189:in find_color_palette_reference' 24: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:115:inblock (4 levels) in process_space' 23: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:215:in rewrite_color_palette!' 22: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/command.rb:156:incolor_collection' 21: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:106:in method_missing' 20: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:139:ininvoke_remote' 19: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:96:in get' 18: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:304:inrequest' 17: from /Library/Ruby/Gems/2.6.0/gems/sawyer-0.8.2/lib/sawyer/agent.rb:94:in call' 16: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:138:inget' 15: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:387:in run_request' 14: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/rack_builder.rb:143:inbuild_response' 13: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/response.rb:8:in call' 12: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:38:incall' 11: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:92:in with_net_http_connection' 10: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:43:inblock in call' 9: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:85:in perform_request' 8: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1228:inget' 7: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1470:in request' 6: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:919:instart' 5: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:930:in do_start' 4: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:945:inconnect' 3: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/timeout.rb:103:in timeout' 2: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:947:inblock in connect' 1: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:947:in open' /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:947:ininitialize': execution expired (Faraday::ConnectionFailed)

vpoiesz commented 2 years ago

Hi @tamalampudi , allow me to introduce @tkofford-bytecode who will be assisting with maintenance of this project going forward. He works with Looker's consulting partner Bytecode.

Todd will attempt to reproduce the issue and may have further questions / suggestions for you. Thanks!

ghost commented 2 years ago

Hi @tamalampudi,

The error that is always referenced in your stack trace multiple times is: The color_collection(bdo) is not found

I know that @vpoiesz asked you to try "curl" commands to call the API directly to determine if the problem you are seeing is a network issue or not and that the "login" API call you executed was successful. That's a good thing, but could you try making a few more API calls as follows?

  1. Do the login (again) to get an access_token (the token can be used over and over for API calls until it expires) curl -i -d "client_id=xxxxxx&client_secret=xxxxxx" https://<your-api-host-and-port>/login
  2. Make a call to the "ColorCollection" API to return all color collections existing in the instance curl -i -H "Authorization: token xxxxxxxxxx" https://<your-api-host-and-port>/api/3.1/color_collections
  3. Determine if there's a color collection with id = "bdo" as in the stack trace & if so use another "ColorCollection" API call to retrieve it by its id (i.e., "bdo"). If it doesn't exist, then we can further troubleshoot from there. curl -i -H "Authorization: token xxxxxxxxxx" https://<your-api-host-and-port>/api/3.1/color_collections/bdo
  4. Please post results back to this thread.

Hopefully, this sequence of API calls will give us more clues into the specific issue you are experiencing.

--Todd

tamalampudi commented 2 years ago

Hi Todd,

Please find the required details: (base) SIVANARAYANA.TAMALAMPUDI@SivanarpudisMBP ~ % curl -i -d "client_id=xxxxxxxx&client_secret=xxxxxxxx" https://xpologisticsprod.cloud.looker.com:443/api/3.1/login HTTP/1.1 200 OK Date: Thu, 11 Nov 2021 21:29:43 GMT Content-Type: application/json Content-Length: 99 Connection: keep-alive Vary: Accept-Encoding, Origin X-B3-TraceId: 618d8b475360dbfcda58a25e0ff8c1f1 X-B3-SpanId: da58a25e0ff8c1f1 X-B3-ParentSpanId: da58a25e0ff8c1f1 X-B3-Sampled: 0 X-Content-Type-Options: nosniff Strict-Transport-Security: max-age=15724800; includeSubDomains

{"access_token":"xxxxxxxxxxxxxxxxxx","token_type":"Bearer","expires_in":3599}%

========================================================================================

(base) SIVANARAYANA.TAMALAMPUDI@SivanarpudisMBP ~ % curl -i -H "Authorization: token xxxxxxxxxxxxxxxxxxxx" https://xpologisticsprod.cloud.looker.com:443/api/3.1/color_collections

HTTP/1.1 200 OK Date: Thu, 11 Nov 2021 21:30:05 GMT Content-Type: application/json Content-Length: 35457 Connection: keep-alive Vary: Accept-Encoding Vary: Accept-Encoding, Origin X-B3-TraceId: 618d8b5db8e3f7c1c0c1e7c370827437 X-B3-SpanId: c0c1e7c370827437 X-B3-ParentSpanId: c0c1e7c370827437 X-B3-Sampled: 0 X-Content-Type-Options: nosniff Strict-Transport-Security: max-age=15724800; includeSubDomains

[{"id":"7c56cc21-66e4-41c9-81ce-a60e1c3967b2","label":"Shoreline","categoricalPalettes":[{"id":"5d189dfc-4f46-46f3-822b-bfb0b61777b1","label":"Categorical","type":"Categorical","colors":["#1A73E8","#12B5CB","#E52592","#E8710A","#F9AB00","#7CB342","#9334E6","#80868B","#079c98","#A8A116","#EA4335","#FF8168"]},{"id":"e34425a5-3228-4f76-b45d-2e7cd13a6766","label":"Ordered","type":"Categorical","colors":["#1A73E8","#12B5CB","#079c98","#7CB342","#A8A116","#F9AB00","#FF8168","#E8710A","#EA4335","#E52592","#9334E6","#80868B"]}],"sequentialPalettes":[{"id":"56d0c358-10a0-4fd6-aa0b-b117bef527ab","label":"Sequential white to blue","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#1A73E8","offset":100}]},{"id":"f0077e50-e03c-4a7e-930c-7321b2267283","label":"White to pink","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#E52592","offset":100}]},{"id":"b8e44ce6-d0e6-4bd4-b72c-ab0f595726a6","label":"Green to blue to purple","type":"Sequential","stops":[{"color":"#7CB342","offset":0},{"color":"#24c1e0","offset":33.333333333333336},{"color":"#1a73e8","offset":66.66666666666667},{"color":"#9334e6","offset":100}]},{"id":"c65a64ce-7f46-476b-a320-41345941e5b1","label":"pink to blue","type":"Sequential","stops":[{"color":"#E52592","offset":0},{"color":"#1a73e8","offset":100}]}],"divergingPalettes":[{"id":"4a00499b-c0fe-4b15-a304-4083c07ff4c4","label":"Pink to white to blue","type":"Diverging","stops":[{"color":"#E52592","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#1a73e8","offset":100}]},{"id":"4620e8de-df7a-40e0-89d6-7401f6e64d96","label":"Blue to white to green","type":"Diverging","stops":[{"color":"#1a73e8","offset":0},{"color":"#ffffff","offset":50},{"color":"#7CB342","offset":100}]}]},{"id":"b43731d5-dc87-4a8e-b807-635bef3948e7","label":"Boardwalk","categoricalPalettes":[{"id":"fb7bb53e-b77b-4ab6-8274-9d420d3d73f3","label":"Primary","type":"Categorical","colors":["#3EB0D5","#B1399E","#C2DD67","#592EC2","#4276BE","#72D16D","#FFD95F","#B32F37","#9174F0","#E57947","#75E2E2","#FBB555"]},{"id":"ccba75a3-58c7-4b9c-a931-4ffc59e79cba","label":"Ordered","type":"Categorical","colors":["#75E2E2","#3EB0D5","#4276BE","#592EC2","#9174F0","#B1399E","#B32F37","#E57947","#FBB555","#FFD95F","#C2DD67","#72D16D"]}],"sequentialPalettes":[{"id":"85de97da-2ded-4dec-9dbd-e6a7d36d5825","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#3EB0D5","offset":50},{"color":"#4276BE","offset":100}]},{"id":"afd46b40-e939-4ace-bffd-69d1bb16ee05","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#C2DD67","offset":50},{"color":"#72D16D","offset":100}]},{"id":"471a8295-662d-46fc-bd2d-2d0acd370c1e","label":"Sequential","type":"Sequential","stops":[{"color":"#C6DAF6","offset":0},{"color":"#3EB0D5","offset":33.333333333333336},{"color":"#4276BE","offset":66.66666666666667},{"color":"#592EC2","offset":100}]},{"id":"1ebd8493-ebcc-4e57-a4ff-ab3e6111da24","label":"Sequential","type":"Sequential","stops":[{"color":"#E4FA9A","offset":0},{"color":"#C2DD67","offset":25},{"color":"#3EB0D5","offset":50},{"color":"#4276BE","offset":75},{"color":"#592EC2","offset":100}]}],"divergingPalettes":[{"id":"1e4d66b9-f066-4c33-b0b7-cc10b4810688","label":"Diverging","type":"Diverging","stops":[{"color":"#E57947","offset":0},{"color":"#FBB555","offset":25},{"color":"#ffffff","offset":50},{"color":"#3EB0D5","offset":75},{"color":"#4276BE","offset":100}]},{"id":"4a543302-b64d-409c-9863-679b5b230aac","label":"Diverging","type":"Diverging","stops":[{"color":"#4276BE","offset":0},{"color":"#3EB0D5","offset":25},{"color":"#ffffff","offset":50},{"color":"#C2DD67","offset":75},{"color":"#72D16D","offset":100}]}]},{"id":"1297ec12-86a5-4ae0-9dfc-82de70b3806a","label":"Breeze","categoricalPalettes":[{"id":"93f8aeb4-3f4a-4cd7-8fee-88c3417516a1","label":"Categorical","type":"Categorical","colors":["#FCCF41","#7CC8FA","#f56776","#10C871","#FD9577","#9E7FD0","#AEC8C1","#ACE9F5","#A5EF55","#C8A7F9","#F29ED2","#FDEC85"]},{"id":"d3bbf1c2-a6ec-4210-b1e7-3e48461cc45b","label":"Ordered","type":"Categorical","colors":["#FCCF41","#A5EF55","#10C871","#7CC8FA","#ACE9F5","#C8A7F9","#9E7FD0","#f56776","#FD9577","#FDEC85","#AEC8C1","#F29ED2"]}],"sequentialPalettes":[{"id":"b6d19921-b2be-4bb1-88be-73eb21d3861e","label":"Sequential","type":"Sequential","stops":[{"color":"#E8F6FF","offset":0},{"color":"#9FD5F8","offset":50},{"color":"#7CC8FA","offset":100}]},{"id":"95851a99-e5ef-4495-b0a7-e9a8cc984eb4","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#FCCF41","offset":100}]},{"id":"a3f9463f-88e2-450e-9363-9525c96ecd6d","label":"Sequential","type":"Sequential","stops":[{"color":"#ACE9F5","offset":0},{"color":"#7CC8FA","offset":33.333333333333336},{"color":"#54AAE2","offset":66.66666666666667},{"color":"#9E7FD0","offset":100}]},{"id":"f29a5dfe-5665-4644-be18-468392d6af10","label":"Sequential","type":"Sequential","stops":[{"color":"#FDEC85","offset":0},{"color":"#FCCF41","offset":33.333333333333336},{"color":"#FD9577","offset":66.66666666666667},{"color":"#f56776","offset":100}]}],"divergingPalettes":[{"id":"99d2d3ac-7579-41a0-b16c-a381b7ae96da","label":"Diverging","type":"Diverging","stops":[{"color":"#f56776","offset":0},{"color":"#FD9577","offset":25},{"color":"#FFFFFF","offset":50},{"color":"#ACE9F5","offset":75},{"color":"#54AAE2","offset":100}]},{"id":"39798c77-0126-4f2f-a920-8d7ce381fa5a","label":"Diverging","type":"Diverging","stops":[{"color":"#FD9577","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#A5EF55","offset":100}]}]},{"id":"5591d8d1-6b49-4f8e-bafa-b874d82f8eb7","label":"Vivid","categoricalPalettes":[{"id":"18d0c733-1d87-42a9-934f-4ba8ef81d736","label":"Categorical","type":"Categorical","colors":["#3D52B9","#08B248","#A918B4","#FC2E31","#FC9200","#2B99F7","#C9DC10","#fa2f90","#FCBF00","#24BED5","#149888","#6F38BB"]},{"id":"b88b6581-484a-4f48-b65b-6631648f867e","label":"Ordered","type":"Categorical","colors":["#FCBF00","#FC9200","#FC2E31","#fa2f90","#A918B4","#6F38BB","#3D52B9","#2B99F7","#24BED5","#149888","#08B248","#C9DC10"]}],"sequentialPalettes":[{"id":"97ce1e3f-9504-4d5c-835b-3fbaf78c084a","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#3D52B9","offset":100}]},{"id":"5378478f-6725-4b04-89cc-75fc42da804e","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#FC2E31","offset":100}]},{"id":"0fa90fe5-14a6-47f1-a9e8-4e0d1bd95763","label":"Sequential","type":"Sequential","stops":[{"color":"#A918B4","offset":0},{"color":"#3D52B9","offset":50},{"color":"#08B248","offset":100}]},{"id":"47dcb9e8-1a4d-43ce-8071-6f4b64d5e85a","label":"Sequential","type":"Sequential","stops":[{"color":"#3D52B9","offset":0},{"color":"#08B248","offset":50},{"color":"#C9DC10","offset":100}]}],"divergingPalettes":[{"id":"a8099e89-1c44-43dd-a3b4-7b76fdc3e338","label":"Diverging","type":"Diverging","stops":[{"color":"#FC2E31","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#3D52B9","offset":100}]},{"id":"57bef7ef-25c4-448e-83df-9c4de399305d","label":"Diverging","type":"Diverging","stops":[{"color":"#FC2E31","offset":0},{"color":"#ffffff","offset":50},{"color":"#08B248","offset":100}]}]},{"id":"aed851c8-b22d-4b01-8fff-4b02b91fe78d","label":"Springfield","categoricalPalettes":[{"id":"c36094e3-d04d-4aa4-8ec7-bc9af9f851f4","label":"Categorical","type":"Categorical","colors":["#81BE56","#CCC54B","#55A3B3","#F9CB67","#80CABB","#FCA33D","#6877A4","#7C478E","#F57237","#D14242","#CD3B8A","#AF71CB"]},{"id":"52550bde-5d63-4b91-9b67-2aed0fb2f505","label":"Ordered","type":"Categorical","colors":["#81BE56","#CCC54B","#FCC03E","#FCA33D","#F57237","#D03333","#CD3B8A","#AF71CB","#763A8B","#6877A4","#55A3B3","#80CABB"]}],"sequentialPalettes":[{"id":"a77d2b8b-ee06-4086-8459-cfff9cccb2d2","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#8DC069","offset":100}]},{"id":"2da48dd9-f8f5-45cc-81a6-74037767d59b","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#F9CB67","offset":100}]},{"id":"396e0019-9589-49fd-9268-9abe8a4bb230","label":"Sequential","type":"Sequential","stops":[{"color":"#F8ED9D","offset":0},{"color":"#E0E992","offset":33.333333333333336},{"color":"#8DC069","offset":66.66666666666667},{"color":"#55A3B3","offset":100}]},{"id":"d0d36d2d-883f-4e68-95fc-e4a12abd9a30","label":"Sequential","type":"Sequential","stops":[{"color":"#CCC54B","offset":0},{"color":"#81BE56","offset":33.333333333333336},{"color":"#55A3B3","offset":66.66666666666667},{"color":"#6877A4","offset":100}]}],"divergingPalettes":[{"id":"6dda4f8b-4e73-4e50-8760-eb378041ce07","label":"Diverging","type":"Diverging","stops":[{"color":"#FCA33D","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#81BE56","offset":100}]},{"id":"e26878fa-802e-47d9-9478-62fb4307f763","label":"Diverging","type":"Diverging","stops":[{"color":"#D03433","offset":0},{"color":"#F67738","offset":25},{"color":"#FCC03E","offset":50},{"color":"#CBC54B","offset":75},{"color":"#83BE55","offset":100}]}]},{"id":"ed5756e2-1ba8-4233-97d2-d565e309c03b","label":"Cowells","categoricalPalettes":[{"id":"ff31218a-4f9d-493c-ade2-22266f5934b8","label":"Categorical","type":"Categorical","colors":["#AA397F","#2586A4","#C9D275","#CF4C6B","#58A07D","#5E3FC5","#EBBE60","#DB5E61","#404FC4","#35ADDC","#8735C1","#F5E578","#E6985A","#3B8EF3","#6177A5","#6C5174"]},{"id":"51c093db-6fea-4370-a918-d6141bccf016","label":"Ordered","type":"Categorical","colors":["#CF4C6B","#AA397F","#8735C1","#5E3FC5","#404FC4","#3B8EF3","#35ADDC","#2586A4","#58A07D","#C9D275","#F5E578","#EBBE60","#E6985A","#DB5E61","#6177A5","#6C5174"]}],"sequentialPalettes":[{"id":"ce78c2ac-5f9c-4443-90ba-dede3e8cb0e8","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#AA397F","offset":100}]},{"id":"bc9e0d1c-0541-4cc1-9aff-854954fc0121","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#404FC4","offset":100}]},{"id":"8e69d1e5-0beb-4ac0-9df0-33b24fa59ac7","label":"Sequential","type":"Sequential","stops":[{"color":"#C9D275","offset":0},{"color":"#2586A4","offset":33.333333333333336},{"color":"#404FC4","offset":66.66666666666667},{"color":"#AA397F","offset":100}]},{"id":"c0a26a97-018c-4b6a-9f39-b15008a3f4a5","label":"Sequential","type":"Sequential","stops":[{"color":"#AA397F","offset":0},{"color":"#8735C1","offset":25},{"color":"#404FC4","offset":50},{"color":"#3B8EF3","offset":75},{"color":"#35ADDC","offset":100}]}],"divergingPalettes":[{"id":"ce148433-817b-4aee-aaea-880394d1f089","label":"Diverging","type":"Diverging","stops":[{"color":"#CF4C6B","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#58A07D","offset":100}]},{"id":"8344d4a0-7db6-4a4c-9019-4924388f3183","label":"Diverging","type":"Diverging","stops":[{"color":"#CF4C6B","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#404FC4","offset":100}]}]},{"id":"9d1da669-a6b4-4a4f-8519-3ea8723b79b5","label":"Organic","categoricalPalettes":[{"id":"0c5264fb-0681-4817-b9a5-d3c81002ce4c","label":"Categorical","type":"Categorical","colors":["#74A09F","#ADAA8D","#EBC667","#C0D918","#85C0DE","#49CEC0","#AE6262","#CE642D","#92CF50","#F2E271","#AEC8C1","#0DADBD"]},{"id":"53f185d2-c73c-4aa7-9b3e-c56a440c3743","label":"Ordered","type":"Categorical","colors":["#AE6262","#CE642D","#EBC667","#F2E271","#C0D918","#92CF50","#49CEC0","#0dadbd","#85c0de","#74A09F","#AEC8C1","#ADAA8D"]}],"sequentialPalettes":[{"id":"35e9e067-0bf1-479b-88b2-b05622c0096d","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#74A09F","offset":100}]},{"id":"a0233bb4-79d9-42f3-95dc-cf21f14072a8","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#CE642D","offset":100}]},{"id":"b67e0c87-a728-46ab-8b4a-9c0c1fe6d192","label":"Sequential","type":"Sequential","stops":[{"color":"#74A09F","offset":0},{"color":"#C0D918","offset":50},{"color":"#E5E5E5","offset":100}]},{"id":"fd0771e8-0cba-4b83-b1a8-0dd8e60925a4","label":"Sequential","type":"Sequential","stops":[{"color":"#F9E4AD","offset":0},{"color":"#EBC667","offset":50},{"color":"#CE642D","offset":100}]}],"divergingPalettes":[{"id":"94ff10f1-bc18-49e3-9172-d166ad160bf5","label":"Diverging","type":"Diverging","stops":[{"color":"#CE642D","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#74A09F","offset":100}]},{"id":"b0dc16dd-da82-46d0-9962-24489004d0e9","label":"Diverging","type":"Diverging","stops":[{"color":"#CE642D","offset":0},{"color":"#ffffff","offset":50},{"color":"#C0D918","offset":100}]}]},{"id":"80e60a97-c02b-4a41-aa05-83522ee2144b","label":"Lighthouse","categoricalPalettes":[{"id":"629b455f-662e-4854-a424-4f0c9d4bbdfb","label":"Categorical","type":"Categorical","colors":["#4276BE","#3FB0D5","#E57947","#FFD95F","#B42F37","#6A013A","#7363A9","#44759A","#FBB556","#D5C679","#9ED7D7","#D59E79"]},{"id":"8b146fdb-43c2-42c2-a572-277b13e9ae5c","label":"Ordered","type":"Categorical","colors":["#4276BE","#3FB0D5","#9ED7D7","#E57947","#FBB556","#FFD95F","#D5C679","#D59E79","#B42F37","#6A013A","#7363A9","#44759A"]}],"sequentialPalettes":[{"id":"0fb6d761-0476-4a6d-987f-15f890984d47","label":"Sequential","type":"Sequential","stops":[{"color":"#FFF","offset":0},{"color":"#9ED7D7","offset":50},{"color":"#4276BE","offset":100}]},{"id":"775f4110-f7cc-4476-9240-6ed8975314ea","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#E57947","offset":100}]},{"id":"0cc9e709-0004-4166-adc2-c979c6a55ca0","label":"Sequential","type":"Sequential","stops":[{"color":"#4276BE","offset":0},{"color":"#3FB0D5","offset":25},{"color":"#FFD95F","offset":50},{"color":"#FBB556","offset":75},{"color":"#B42F37","offset":100}]},{"id":"ac6ae05d-f9a3-4ac3-b7b8-1be843c74609","label":"Sequential","type":"Sequential","stops":[{"color":"#FFD95F","offset":0},{"color":"#FAA25F","offset":33.333333333333336},{"color":"#CC5848","offset":66.66666666666667},{"color":"#A01C37","offset":100}]}],"divergingPalettes":[{"id":"1353e25c-50e6-4d4d-9abc-4477189bd36d","label":"Diverging","type":"Diverging","stops":[{"color":"#A01C37","offset":0},{"color":"#DB6E41","offset":25},{"color":"#FFFFFF","offset":50},{"color":"#9ED7D7","offset":75},{"color":"#4276BE","offset":100}]},{"id":"807a22b0-53c0-40e2-8b3b-28c8e266b0ea","label":"Diverging","type":"Diverging","stops":[{"color":"#B42F37","offset":0},{"color":"#FBB556","offset":25},{"color":"#FBFCF5","offset":50},{"color":"#3FB0D5","offset":75},{"color":"#462C9D","offset":100}]}]},{"id":"7c79334a-9912-4ca1-be6a-35756782ae09","label":"Taos","categoricalPalettes":[{"id":"de0bdb92-9455-489c-afa7-f0e0fdc76078","label":"Categorical","type":"Categorical","colors":["#F15922","#068993","#A85573","#9B8E20","#C75A31","#D9C202","#3F6173","#853955","#F2C73C","#E87F2F","#9B2030","#A8876C"]},{"id":"3f395a8d-960f-4480-a725-63521163b8b8","label":"Ordered","type":"Categorical","colors":["#068993","#3F6173","#853955","#9B2030","#A85573","#C75A31","#F15922","#E87F2F","#F2C73C","#D9C202","#9B8E20","#A8876C"]}],"sequentialPalettes":[{"id":"acab4a0c-9dd2-48ac-85f3-c7f40364f778","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#7DC1C7","offset":50},{"color":"#068993","offset":100}]},{"id":"9bba0279-71a4-410a-bd57-3afc0dfabaad","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#E87F2F","offset":100}]},{"id":"5b289dc9-1446-49e6-ab05-ba239a94b7a9","label":"Sequential","type":"Sequential","stops":[{"color":"#068993","offset":0},{"color":"#9B8E20","offset":25},{"color":"#D9C202","offset":50},{"color":"#E87F2F","offset":75},{"color":"#C75A31","offset":100}]},{"id":"364b5000-be28-40e9-a495-81343e4830d5","label":"Sequential","type":"Sequential","stops":[{"color":"#9B8E20","offset":0},{"color":"#D9C202","offset":33.333333333333336},{"color":"#E87F2F","offset":66.66666666666667},{"color":"#C75A31","offset":100}]}],"divergingPalettes":[{"id":"c80fe9b3-6c8e-48c6-891b-c9107bae6f6d","label":"Diverging","type":"Diverging","stops":[{"color":"#E87F2F","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#068993","offset":100}]},{"id":"ded8013e-627e-456a-8646-4c7ee6e0b1e7","label":"Diverging","type":"Diverging","stops":[{"color":"#ED480C","offset":0},{"color":"#ffffff","offset":50},{"color":"#068993","offset":100}]}]},{"id":"da8306b5-3b46-48aa-9ead-a3b32292f35c","label":"Sonoma","categoricalPalettes":[{"id":"75905e81-dadc-472c-b9a2-a201f788d55d","label":"Categorical","type":"Categorical","colors":["#4A80BC","#615894","#F0C733","#D13452","#E48522","#B977A9","#DFC858","#CD9D6B","#C4DF58","#7bc739","#c76273","#69d6de"]},{"id":"1e00376f-fcd7-4627-a9f8-c86b83bbbe57","label":"Categorical","type":"Categorical","colors":["#CD9D6B","#E48522","#DFC858","#ded786","#F0C733","#C4DF58","#7bc739","#69d6de","#615894","#D13452","#B977A9","#c76273"]}],"sequentialPalettes":[{"id":"d9abd293-3cd0-448c-9540-4a55690e4ce1","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#4A80BC","offset":100}]},{"id":"00cbdb8d-45a9-40ea-b828-e0d5787dff5c","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#CD9D6B","offset":100}]},{"id":"32f7badf-5872-46b3-ad21-30d088ebf499","label":"Sequential","type":"Sequential","stops":[{"color":"#DFC858","offset":0},{"color":"#C4DF58","offset":50},{"color":"#4A80BC","offset":100}]},{"id":"95584bf9-c29e-41ea-b6e7-79e9c126e177","label":"Sequential","type":"Sequential","stops":[{"color":"#DFC858","offset":0},{"color":"#D13452","offset":100}]}],"divergingPalettes":[{"id":"00fb21bc-5a8c-46b1-88bf-2a6a3d102830","label":"Diverging","type":"Diverging","stops":[{"color":"#9DB5CE","offset":0},{"color":"#ffffff","offset":50},{"color":"#DFC858","offset":100}]},{"id":"4868aae1-d096-4d4d-a37b-8d86e7f50396","label":"Diverging","type":"Diverging","stops":[{"color":"#D13452","offset":0},{"color":"#ffffff","offset":50},{"color":"#C4DF58","offset":100}]}]},{"id":"6c27c30e-5523-4080-82ae-272146e699d0","label":"Casual","categoricalPalettes":[{"id":"87654122-8144-4720-8259-82ac9908d5f4","label":"Categorical","type":"Categorical","colors":["#25435A","#D5DB61","#61A9A5","#FECA36","#9DEDE7","#DBC361","#2B797D","#B8AF6A","#FED85C","#79D0CC","#FFEB8E","#B8F5ED"]},{"id":"6b363a0e-c6fa-4887-8952-5456fdfdf919","label":"Ordered","type":"Categorical","colors":["#25435A","#2B797D","#61A9A5","#79D0CC","#9DEDE7","#B8F5ED","#D5DB61","#FFEB8E","#FED85C","#FECA36","#DBC361","#B8AF6A"]}],"sequentialPalettes":[{"id":"25b877bc-c7a8-4ed0-a0ef-5ba64ca3658d","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#61A9A5","offset":100}]},{"id":"773c99c0-14d0-4595-8eca-9405283af0ee","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#D5DB61","offset":100}]},{"id":"ca5bc734-c8e2-489d-a00e-48c321885a14","label":"Sequential","type":"Sequential","stops":[{"color":"#25435A","offset":0},{"color":"#61A9A5","offset":33.333333333333336},{"color":"#D5DB61","offset":66.66666666666667},{"color":"#FECA36","offset":100}]},{"id":"96e4941d-9ac4-4459-b216-2cdba9745436","label":"Sequential","type":"Sequential","stops":[{"color":"#D5DB61","offset":0},{"color":"#61A9A5","offset":100}]}],"divergingPalettes":[{"id":"dcfbcfd3-50be-453f-badd-e340864c3b1a","label":"Diverging","type":"Diverging","stops":[{"color":"#61A9A5","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#D5DB61","offset":100}]},{"id":"22f16759-9d51-44b0-99bc-2415c9f7ffdf","label":"Diverging","type":"Diverging","stops":[{"color":"#61A9A5","offset":0},{"color":"#B8F5ED","offset":25},{"color":"#FFFFFF","offset":50},{"color":"#FFEB8E","offset":75},{"color":"#D5DB61","offset":100}]}]},{"id":"5f313589-67ce-44ba-b084-ec5107a7bb7e","label":"Sunset","categoricalPalettes":[{"id":"be92eae7-de25-46ae-8e4f-21cb0b69a1f3","label":"Categorical","type":"Categorical","colors":["#462C9D","#FED8A0","#C762AD","#8643B1","#FDA08A","#170658","#BB55B4","#EE9093","#9F4AB4","#683AAE","#D978A1","#FFB690"]},{"id":"f582184b-9f56-4e5b-b1ab-e9777faa4df9","label":"Categorical","type":"Categorical","colors":["#FED8A0","#FFB690","#FDA08A","#EE9093","#D978A1","#C762AD","#BB55B4","#9F4AB4","#8643B1","#683AAE","#462C9D","#170658"]}],"sequentialPalettes":[{"id":"2229f400-11a4-4b0d-b224-abe608161947","label":"Sequential","type":"Sequential","stops":[{"color":"#FBFCF5","offset":0},{"color":"#FED8A0","offset":33.333333333333336},{"color":"#FDA08A","offset":66.66666666666667},{"color":"#D978A1","offset":100}]},{"id":"a418cd33-fecf-4932-9933-dbd6652c610b","label":"Sequential","type":"Sequential","stops":[{"color":"#FBFCF5","offset":0},{"color":"#C762AD","offset":50},{"color":"#462C9D","offset":100}]},{"id":"04e6ee8f-6a09-4649-891f-5bc66082e506","label":"Sequential","type":"Sequential","stops":[{"color":"#FED8A0","offset":0},{"color":"#FDA08A","offset":50},{"color":"#D978A1","offset":100}]},{"id":"b20fe57d-cb13-420f-815b-60e907a43148","label":"Sequential","type":"Sequential","stops":[{"color":"#FED8A0","offset":0},{"color":"#EE9093","offset":25},{"color":"#C25CB0","offset":50},{"color":"#7D40B0","offset":75},{"color":"#462C9D","offset":100}]}],"divergingPalettes":[{"id":"dc65924d-47ce-45e6-a469-9977cbc6bd0e","label":"Diverging","type":"Diverging","stops":[{"color":"#FDA08A","offset":0},{"color":"#FBFCF5","offset":50},{"color":"#683AAE","offset":100}]},{"id":"51c21672-48dc-4ff0-b70e-633687b8a84b","label":"Diverging","type":"Diverging","stops":[{"color":"#FDA08A","offset":0},{"color":"#FED8A0","offset":25},{"color":"#FBFCF5","offset":50},{"color":"#C762AD","offset":75},{"color":"#462C9D","offset":100}]}]},{"id":"5b121cce-cf79-457c-a52a-9162dc174766","label":"Ashland","categoricalPalettes":[{"id":"55dee055-18cf-4472-9669-469322a6f264","label":"Categorical","type":"Categorical","colors":["#462C9D","#3BA2A0","#2865BE","#93CF6C","#170658","#359299","#177BC5","#5DC370","#CADB68","#FFE663","#4CB388","#373EA5"]},{"id":"3090efc0-32d5-441e-85ca-793523ccc782","label":"Ordered","type":"Categorical","colors":["#462C9D","#373EA5","#2865BE","#177BC5","#359299","#3BA2A0","#4CB388","#5DC370","#93CF6C","#CADB68","#FFE663","#170658"]}],"sequentialPalettes":[{"id":"12809dc5-ac61-4801-8878-10c61fb43c60","label":"Sequential Alt","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#436FB8","offset":50},{"color":"#170658","offset":100}]},{"id":"8509a00c-3f06-4a32-a9c0-d1edc5cc3b6d","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#FFE664","offset":25},{"color":"#A1D86A","offset":50},{"color":"#65C78F","offset":75},{"color":"#53a673","offset":100}]},{"id":"313d7e4a-1e68-4f9c-9a5d-3135d8ffaa47","label":"Sequential","type":"Sequential","stops":[{"color":"#FFE663","offset":0},{"color":"#A2D869","offset":25},{"color":"#50BBB3","offset":50},{"color":"#436EB9","offset":75},{"color":"#462C9D","offset":100}]},{"id":"bfafa3ba-b38e-4656-8fe1-9e796981d7f0","label":"Sequential","type":"Sequential","stops":[{"color":"#462C9D","offset":0},{"color":"#436EB9","offset":25},{"color":"#50BBB3","offset":50},{"color":"#A2D869","offset":75},{"color":"#FFE663","offset":100}]}],"divergingPalettes":[{"id":"33649276-c3c6-4405-bf32-14f5c8c1388e","label":"Diverging","type":"Diverging","stops":[{"color":"#3FB0D5","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#73D16D","offset":100}]},{"id":"53b5129e-a17a-41d6-97b9-5e6d89080b45","label":"Diverging","type":"Diverging","stops":[{"color":"#FEE663","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#3FB0D5","offset":100}]}]},{"id":"1bc1f1d8-7461-4bfd-8c3b-424b924287b5","label":"Oasis","categoricalPalettes":[{"id":"dd87bc4e-d86f-47b1-b0fd-44110dc0b469","label":"Categorical","type":"Categorical","colors":["#173589","#3EB0D5","#1E0030","#B4DED2","#1864B4","#E9F3D1","#2693D1","#12165C","#72C5D4","#184EA0","#D2EAD1","#1A81CE"]},{"id":"44596d66-8a4e-463a-84d4-cd5a05aaf752","label":"Ordered","type":"Categorical","colors":["#1E0030","#12165C","#173589","#184EA0","#1864B4","#1A81CE","#2693D1","#3EB0D5","#72C5D4","#B4DED2","#D2EAD1","#E9F3D1"]}],"sequentialPalettes":[{"id":"46a4b248-19f7-4e71-9cf0-59fcc2c3039e","label":"Sequential","type":"Sequential","stops":[{"color":"#FBFCF5","offset":0},{"color":"#E9F3D1","offset":33.333333333333336},{"color":"#B4DED2","offset":66.66666666666667},{"color":"#2693D1","offset":100}]},{"id":"23bcaaee-f734-48ce-b46e-d42726205e7b","label":"Sequential","type":"Sequential","stops":[{"color":"#FFFFFF","offset":0},{"color":"#1864B4","offset":100}]},{"id":"80d0e28a-6146-432d-a064-7bfb639e22f0","label":"Sequential","type":"Sequential","stops":[{"color":"#2693D1","offset":0},{"color":"#B4DED2","offset":50},{"color":"#E9F3D1","offset":100}]},{"id":"0d8b7109-1465-45c9-a6a2-82a0a164786a","label":"Sequential","type":"Sequential","stops":[{"color":"#AEC8C1","offset":0},{"color":"#1864B4","offset":100}]}],"divergingPalettes":[{"id":"ab3e6420-3e2f-42a2-802b-e4e9036b089f","label":"Diverging","type":"Diverging","stops":[{"color":"#AEC8C1","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#1864B4","offset":100}]},{"id":"cf9f8b2c-caef-4fb5-83f6-79c5abfce653","label":"Diverging","type":"Diverging","stops":[{"color":"#E9F3D1","offset":0},{"color":"#FFFFFF","offset":50},{"color":"#1864B4","offset":100}]}]},{"id":"d754397b-2c05-4470-bbbb-05eb4c2b15cd","label":"Dalton","categoricalPalettes":[{"id":"b0768e0d-03b8-4c12-9e30-9ada6affc357","label":"Categorical","type":"Categorical","colors":["#215AC8","#FA7850","#8214A0","#2CA0FA","#0BB45B","#DCCAA6","#26D2DC","#126E82","#9FFA82","#AA0A3C","#F0F031","#FA78F9"]},{"id":"a0f97728-49ea-4123-b57e-ec4c57803f8b","label":"Categorical","type":"Categorical","colors":["#FA7850","#AA0A3C","#8214A0","#215AC8","#126E82","#0BB45B","#9FFA82","#26D2DC","#2CA0FA","#DCCAA6","#F0F031","#FA78F9"]}],"sequentialPalettes":[{"id":"628a997f-dd44-4060-a913-250041880199","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#215AC8","offset":100}]},{"id":"31046485-0ab5-406e-b80e-e780acab5160","label":"Sequential","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#AA0A3C","offset":100}]},{"id":"5196a570-95f8-4337-859e-97bf8af31443","label":"Sequential","type":"Sequential","stops":[{"color":"#FA7850","offset":0},{"color":"#AA0A3C","offset":50},{"color":"#215AC8","offset":100}]},{"id":"6c08307a-1a28-4f24-95a0-29f67b33495a","label":"Sequential","type":"Sequential","stops":[{"color":"#DCCAA6","offset":0},{"color":"#AA0A3C","offset":100}]}],"divergingPalettes":[{"id":"4dadd4d2-40af-451b-bcdd-1dfaedf76163","label":"Diverging","type":"Diverging","stops":[{"color":"#AA0A3C","offset":0},{"color":"#ffffff","offset":50},{"color":"#126E82","offset":100}]},{"id":"be8327bf-9384-449e-8412-84949763505b","label":"Diverging","type":"Diverging","stops":[{"color":"#215AC8","offset":0},{"color":"#ffffff","offset":50},{"color":"#126E82","offset":100}]}]},{"id":"legacy","label":"Legacy","categoricalPalettes":[{"id":"looker_classic","label":"Looker Classic","type":"Categorical","colors":["#62bad4","#a9c574","#929292","#9fdee0","#1f3e5a","#90c8ae","#92818d","#c5c6a6","#82c2ca","#cee0a0","#928fb4","#9fc190"]},{"id":"santa_cruz","label":"Santa Cruz","type":"Categorical","colors":["#5245ed","#ed6168","#1ea8df","#353b49","#49cec1","#b3a0dd","#db7f2a","#706080","#a2dcf3","#776fdf","#e9b404","#635189"]},{"id":"mixed_dark","label":"Mixed Dark","type":"Categorical","colors":["#a6cee3","#1f78b4","#b2df8a","#33a02c","#fb9a99","#e31a1c","#fdbf6f","#ff7f00","#cab2d6","#6a3d9a","#edbc0e","#b15928"]},{"id":"mixed_pastels","label":"Mixed Pastels","type":"Categorical","colors":["#8dd3c7","#ffed6f","#bebada","#fb8072","#80b1d3","#fdb462","#b3de69","#fccde5","#d9d9d9","#bc80bd","#ccebc5","#a3a3ff"]},{"id":"mixed_neutrals","label":"Mixed Neutrals","type":"Categorical","colors":["#294987","#5a1038","#ff947c","#1f6b62","#764173","#910303","#b2947c","#192d54","#a31e67","#a16154","#0f544b","#ffd9ba"]},{"id":"random","label":"Random","type":"Categorical","colors":["#265780","#D98541","#C53DCC","#33992E","#36B38D","#A2BF39","#5A3DCC","#8a0f3d","#ff7aa3","#2d89bd","#8f09b0","#d94141"]},{"id":"tomato_to_steel_blue","label":"Tomato to Steel Blue","type":"Categorical","colors":["#F16358","#E0635E","#D06464","#BF656B","#AF6671","#9F6777","#8E687E","#7E6984","#6E6A8A","#5D6B91","#4D6C97","#3D6D9E"]},{"id":"green_to_red","label":"Green to Red","type":"Categorical","colors":["#7FCDAE","#7ED09C","#7DD389","#85D67C","#9AD97B","#B1DB7A","#CADF79","#E2DF78","#E5C877","#E7AF75","#EB9474","#EE7772"]},{"id":"fuchsia_to_green","label":"Fuchsia to Green","type":"Categorical","colors":["#8d4074","#a15e8a","#b57ba0","#c899b7","#dcb7cf","#efd7e7","#e0e9cc","#bcd0a6","#97b780","#749e5b","#508637","#286f0f"]},{"id":"black_to_gray","label":"Black to Gray","type":"Categorical","colors":["#000000","#191919","#292929","#3c3c3c","#4e4e4e","#626262","#777777","#8d8d8d","#a3a3a3","#b9b9b9","#d0d0d0","#e7e7e7"]}],"sequentialPalettes":[{"id":"legacy_sequential3","label":"Red to Blue","type":"Sequential","stops":[{"color":"#ff0000","offset":0},{"color":"#0000ff","offset":100}]},{"id":"legacy_sequential1","label":"Red to White","type":"Sequential","stops":[{"color":"#F36254","offset":0},{"color":"#ffffff","offset":100}]},{"id":"legacy_sequential2","label":"White to Green","type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#4FBC89","offset":100}]}],"divergingPalettes":[{"id":"legacy_diverging1","label":"Red to Yellow to Green","type":"Diverging","stops":[{"color":"#F36254","offset":0},{"color":"#FCF758","offset":50},{"color":"#4FBC89","offset":100}]},{"id":"legacy_diverging2","label":"Red to White to Green","type":"Diverging","stops":[{"color":"#F36254","offset":0},{"color":"#ffffff","offset":50},{"color":"#4FBC89","offset":100}]}]},{"id":"xpo-corp-qualitative-3","label":"XPO Corp Qualitative 3","categoricalPalettes":[{"id":"xpo-corp-qualitative-3-categorical-0","label":null,"type":"Categorical","colors":["#CC0000","#1E88E5","#C0CA33","#B0B0B0"]}],"sequentialPalettes":[{"id":"xpo-corp-qualitative-3-sequential-0","label":null,"type":"Sequential","stops":[{"color":"#CC0000","offset":0},{"color":"#1E88E5","offset":33.333333333333336},{"color":"#C0CA33","offset":66.66666666666667},{"color":"#B0B0B0","offset":100}]}],"divergingPalettes":[{"id":"xpo-corp-qualitative-3-diverging-0","label":null,"type":"Diverging","stops":[{"color":"#CC0000","offset":0},{"color":"#1E88E5","offset":33.333333333333336},{"color":"#C0CA33","offset":66.66666666666667},{"color":"#B0B0B0","offset":100}]}]},{"id":"xpo-corp-success","label":"XPO Corp Success","categoricalPalettes":[{"id":"xpo-corp-success-categorical-0","label":null,"type":"Categorical","colors":["#4CAF50"]}],"sequentialPalettes":[{"id":"xpo-corp-success-sequential-0","label":null,"type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#43494D","offset":100}]}],"divergingPalettes":[{"id":"xpo-corp-success-diverging-0","label":null,"type":"Diverging","stops":[{"color":"#ffffff","offset":0},{"color":"#3EB0D5","offset":100}]}]},{"id":"xpo-corporate-qualitative-1","label":"XPO Corp Qualitative 1","categoricalPalettes":[{"id":"xpo-corporate-qualitative-1-categorical-0","label":null,"type":"Categorical","colors":["#CC0000","#000000","#43494D","#858585","#DDDDDD"]}],"sequentialPalettes":[{"id":"xpo-corporate-qualitative-1-sequential-0","label":null,"type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#43494D","offset":100}]}],"divergingPalettes":[{"id":"xpo-corporate-qualitative-1-diverging-0","label":null,"type":"Diverging","stops":[{"color":"#ffffff","offset":0},{"color":"#3EB0D5","offset":100}]}]},{"id":"xpo-corporate-qualitative-2","label":"XPO Corp Qualitative 2","categoricalPalettes":[{"id":"xpo-corporate-qualitative-2-categorical-0","label":null,"type":"Categorical","colors":["#CC0000","#1E88E5","#C0CA33","#3949AB","#F4511E","#D81B60","#FFEB3B","#00897B","#B0B0B0","#000000","#43494D","#858585","#DDDDDD"]}],"sequentialPalettes":[{"id":"xpo-corporate-qualitative-2-sequential-0","label":null,"type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#43494D","offset":100}]}],"divergingPalettes":[{"id":"xpo-corporate-qualitative-2-diverging-0","label":null,"type":"Diverging","stops":[{"color":"#ffffff","offset":0},{"color":"#3EB0D5","offset":100}]}]},{"id":"xpo-diverging-palette","label":"XPO Diverging Palette","categoricalPalettes":[{"id":"xpo-diverging-palette-categorical-0","label":null,"type":"Categorical","colors":["#00897B","#79AB88","#B2C692","#E9E29C","#F7BA6E","#FE913F","#F4511E","#0D47A1","#707BBC","#B1B4D7","#DDE3ED","#B1C2A7","#739561","#33691E","#212121","#5A5A5A","#9B9B9B","#E0E0E0","#9B9B9B","#5A5A5A","#212121","#4DB6AC","#93CDC4","#CBE4D9","#FFFDE7","#FFC7B5","#FFA284","#FF8A65","#1E88E5","#81A9EA","#BCCCEE","#F6F7FA","#CCDCB6","#A5C87D","#7CB342","#757575","#9F9F9F","#CBCCCB","#FAFAFA","#CBCCCB","#9F9F9F","#757575"]}],"sequentialPalettes":[{"id":"xpo-diverging-palette-sequential-0","label":null,"type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#3EB0D5","offset":50},{"color":"#4276BE","offset":100}]}],"divergingPalettes":[{"id":"xpo-diverging-palette-diverging-0","label":null,"type":"Diverging","stops":[{"color":"#E57947","offset":0},{"color":"#FBB555","offset":25},{"color":"#ffffff","offset":50},{"color":"#3EB0D5","offset":75},{"color":"#4276BE","offset":100}]}]},{"id":"xpo-qualitative-palette","label":"XPO Qualitative Palette","categoricalPalettes":[{"id":"xpo-qualitative-palette-categorical-0","label":null,"type":"Categorical","colors":["#1E88E5","#C0CA33","#3949AB","#F4511E","#D81B60","#FFEB3B","#00897B","#B0B0B0","#080808","#686868","#282828","#888888","#484848","#64B5F6","#DCE775","#7986CB","#FF8A65","#F8BBD0","#FFF59D","#4DB6AC","#F8F8F8","#686868","#D3D3D3","#888888","#B0B0B0"]}],"sequentialPalettes":[{"id":"xpo-qualitative-palette-sequential-0","label":null,"type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#3EB0D5","offset":50},{"color":"#4276BE","offset":100}]}],"divergingPalettes":[{"id":"xpo-qualitative-palette-diverging-0","label":null,"type":"Diverging","stops":[{"color":"#E57947","offset":0},{"color":"#FBB555","offset":25},{"color":"#ffffff","offset":50},{"color":"#3EB0D5","offset":75},{"color":"#4276BE","offset":100}]}]},{"id":"xpo-sequential-palette","label":"XPO Sequential Palette","categoricalPalettes":[{"id":"xpo-sequential-palette-categorical-0","label":null,"type":"Categorical","colors":["#0D47A1","#2C59AF","#336ABD","#417CCB","#4D8FD9","#59A2E8","#64B5F6","#0D47A1","#485EA3","#61739A","#788A94","#8CA290","#9DBB89","#AED581","#212121","#424242","#616161","#757575","#9E9E9E","#BDBDBD","#E0E0E0","#E3F2FD","#CBDFF9","#B2CDF6","#97BBF2","#7AAAEE","#5799E9","#1E88E5","#F1F8E9","#D8E4E9","#BDD1E9","#A1BEE8","#82ABE7","#5D99E6","#1E88E5","#FAFAFA","#F5F5F5","#E0E0E0","#BDBDBD","#9E9E9E","#757575","#616161"]}],"sequentialPalettes":[{"id":"xpo-sequential-palette-sequential-0","label":null,"type":"Sequential","stops":[{"color":"#ffffff","offset":0},{"color":"#3EB0D5","offset":50},{"color":"#4276BE","offset":100}]}],"divergingPalettes":[{"id":"xpo-sequential-palette-diverging-0","label":null,"type":"Diverging","stops":[{"color":"#E57947","offset":0},{"color":"#FBB555","offset":25},{"color":"#ffffff","offset":50},{"color":"#3EB0D5","offset":75},{"color":"#4276BE","offset":100}]}]}]%

========================================================================================

(base) SIVANARAYANA.TAMALAMPUDI@SivanarpudisMBP ~ % curl -i -H "Authorization: token xxxxxxxxxxxxxxxx" https://xpologisticsprod.cloud.looker.com:443/api/3.1/color_collections/bdo HTTP/1.1 404 Not Found Date: Thu, 11 Nov 2021 21:30:18 GMT Content-Type: / Connection: close

<!DOCTYPE html>

Looker Not Found (404)
Looker

Looker is unavailable.

If you typed in a URL, double-check the spelling.

This may also be due to a temporary condition such as an outage, scheduled maintenance or upgrade.


If this message persists or you have any concerns,
contact us from help.looker.com and we'll respond promptly.

ghost commented 2 years ago

@tamalampudi I didn't really see anything out of the ordinary with the output you provided from the API calls, other than some of the color collections had null labels, which I don't "think" is an issue.

Can you try to run the gazer command again, but specify the "--debug" flag?

tamalampudi commented 2 years ago

Hi

I have executed the below commands :

1)gzr space export 1 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxx' --client-secret='xxxxxx' --debug --> No issues been identified, i can able to take the shared [export 1] backup completely without any issues, strange thing the same command used to give timeout error before many times.

2)gzr space export 2 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxx' --client-secret='xxxxxx' --debug --> when i execute this command for personal spaces backup i am getting the below error after few seconds:

===================================================================== (base) SIVANARAYANA.TAMALAMPUDI@SivanarpudisMBP prodbackup-11122021 % gzr space export 2 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxx' --client-secret='xxxxxxx' --debug options: {"debug"=>true, "host"=>"xpologisticsprod.cloud.looker.com", "port"=>"443", "ssl"=>true, "verify_ssl"=>true, "timeout"=>60, "force"=>false, "client_id"=>"xxxxxx", "client_secret"=>"4kYwsxHshm9dnvKg5tRYXqyf", "dir"=>"."} API 3.1 available? true connecting to ["api_endpoint=>https://xpologisticsprod.cloud.looker.com:443/api/3.1", "connection_options=>{:ssl=>{:verify=>true, :verify_mode=>3}, :request=>{:timeout=>60}}", "user_agent=>Gazer 0.2.44", "client_id=>xxxxxxx", "client_secret=>*****"] check for connectivity: true verify authentication: true performing color_palette_lookup! on { "id": "xpo-corp-success", "label": "XPO Corp Success", "categoricalPalettes": [ { "id": "xpo-corp-success-categorical-0", "label": null, "type": "Categorical", "colors": [ "#4CAF50" ] } ], "sequentialPalettes": [ { "id": "xpo-corp-success-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] } ], "divergingPalettes": [ { "id": "xpo-corp-success-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] } got palettes [ { "id": "xpo-corp-success-categorical-0", "label": null, "type": "Categorical", "colors": [ "#4CAF50" ] }, { "id": "xpo-corp-success-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] }, { "id": "xpo-corp-success-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] Default colors { "id": "xpo-corp-success", "label": "XPO Corp Success", "categoricalPalettes": [ { "id": "xpo-corp-success-categorical-0", "label": null, "type": "Categorical", "colors": [ "#4CAF50" ] } ], "sequentialPalettes": [ { "id": "xpo-corp-success-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] } ], "divergingPalettes": [ { "id": "xpo-corp-success-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ], "palettes": [ { "id": "xpo-corp-success-categorical-0", "label": null, "type": "Categorical", "colors": [ "#4CAF50" ] }, { "id": "xpo-corp-success-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] }, { "id": "xpo-corp-success-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] } looking up color collection by id xpo-corporate-qualitative-1 performing color_palette_lookup! on { "id": "xpo-corporate-qualitative-1", "label": "XPO Corp Qualitative 1", "categoricalPalettes": [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] } ], "sequentialPalettes": [ { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] } ], "divergingPalettes": [ { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] } got palettes [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] }, { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] }, { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] got color collection { "id": "xpo-corporate-qualitative-1", "label": "XPO Corp Qualitative 1", "categoricalPalettes": [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] } ], "sequentialPalettes": [ { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] } ], "divergingPalettes": [ { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ], "palettes": [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] }, { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] }, { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] }

--Removed content for readability--

looking up color collection by id xpo-corporate-qualitative-1 performing color_palette_lookup! on { "id": "xpo-corporate-qualitative-1", "label": "XPO Corp Qualitative 1", "categoricalPalettes": [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] } ], "sequentialPalettes": [ { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] } ], "divergingPalettes": [ { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] } got palettes [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] }, { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] }, { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] got color collection { "id": "xpo-corporate-qualitative-1", "label": "XPO Corp Qualitative 1", "categoricalPalettes": [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] } ], "sequentialPalettes": [ { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] } ], "divergingPalettes": [ { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ], "palettes": [ { "id": "xpo-corporate-qualitative-1-categorical-0", "label": null, "type": "Categorical", "colors": [ "#CC0000", "#000000", "#43494D", "#858585", "#DDDDDD" ] }, { "id": "xpo-corporate-qualitative-1-sequential-0", "label": null, "type": "Sequential", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#43494D", "offset": 100 } ] }, { "id": "xpo-corporate-qualitative-1-diverging-0", "label": null, "type": "Diverging", "stops": [ { "color": "#ffffff", "offset": 0 }, { "color": "#3EB0D5", "offset": 100 } ] } ] } logout Traceback (most recent call last): 43: from /usr/local/bin/gzr:23:in <main>' 42: from /usr/local/bin/gzr:23:inload' 41: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/exe/gzr:36:in <top (required)>' 40: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:instart' 39: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in dispatch' 38: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:ininvoke_command' 37: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in run' 36: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:238:inblock in subcommand' 35: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:115:in invoke' 34: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:indispatch' 33: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in invoke_command' 32: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:inrun' 31: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space.rb:80:in export' 30: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:49:inexecute' 29: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/session.rb:207:in with_session' 28: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:81:inblock in execute' 27: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:136:in process_space' 26: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/space.rb:135:inquery_space_children' 25: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:106:in method_missing' 24: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:139:ininvoke_remote' 23: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:96:in get' 22: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:304:inrequest' 21: from /Library/Ruby/Gems/2.6.0/gems/sawyer-0.8.2/lib/sawyer/agent.rb:94:in call' 20: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:138:inget' 19: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:387:in run_request' 18: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/rack_builder.rb:143:inbuild_response' 17: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/response.rb:8:in call' 16: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:38:incall' 15: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:92:in with_net_http_connection' 14: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:43:inblock in call' 13: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:85:in perform_request' 12: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1228:inget' 11: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1470:in request' 10: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:920:instart' 9: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1472:in block in request' 8: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1479:inrequest' 7: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:in transport_request' 6: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:incatch' 5: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1509:in block in transport_request' 4: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:29:inread_new' 3: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:40:in read_status_line' 2: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:201:inreadline' 1: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:191:in readuntil' /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:217:inrbuf_fill': Net::ReadTimeout with #<TCPSocket:(closed)> (Net::ReadTimeout) 43: from /usr/local/bin/gzr:23:in <main>' 42: from /usr/local/bin/gzr:23:inload' 41: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/exe/gzr:36:in <top (required)>' 40: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/base.rb:466:instart' 39: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:in dispatch' 38: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:ininvoke_command' 37: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:in run' 36: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:238:inblock in subcommand' 35: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:115:in invoke' 34: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor.rb:387:indispatch' 33: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/invocation.rb:126:in invoke_command' 32: from /Library/Ruby/Gems/2.6.0/gems/thor-0.20.3/lib/thor/command.rb:27:inrun' 31: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space.rb:80:in export' 30: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:49:inexecute' 29: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/session.rb:207:in with_session' 28: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:81:inblock in execute' 27: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/commands/space/export.rb:136:in process_space' 26: from /Library/Ruby/Gems/2.6.0/gems/gazer-0.2.44/lib/gzr/modules/space.rb:135:inquery_space_children' 25: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:106:in method_missing' 24: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client/dynamic.rb:139:ininvoke_remote' 23: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:96:in get' 22: from /Library/Ruby/Gems/2.6.0/gems/looker-sdk-0.0.7/lib/looker-sdk/client.rb:304:inrequest' 21: from /Library/Ruby/Gems/2.6.0/gems/sawyer-0.8.2/lib/sawyer/agent.rb:94:in call' 20: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:138:inget' 19: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/connection.rb:387:in run_request' 18: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/rack_builder.rb:143:inbuild_response' 17: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/response.rb:8:in call' 16: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:38:incall' 15: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:92:in with_net_http_connection' 14: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:43:inblock in call' 13: from /Library/Ruby/Gems/2.6.0/gems/faraday-0.17.3/lib/faraday/adapter/net_http.rb:85:in perform_request' 12: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1228:inget' 11: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1470:in request' 10: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:920:instart' 9: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1472:in block in request' 8: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1479:inrequest' 7: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:in transport_request' 6: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1506:incatch' 5: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http.rb:1509:in block in transport_request' 4: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:29:inread_new' 3: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/http/response.rb:40:in read_status_line' 2: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:201:inreadline' 1: from /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:191:in readuntil' /System/Library/Frameworks/Ruby.framework/Versions/2.6/usr/lib/ruby/2.6.0/net/protocol.rb:217:inrbuf_fill': Net::ReadTimeout with #<TCPSocket:(closed)> (Faraday::TimeoutError) (base) SIVANARAYANA.TAMALAMPUDI@SivanarpudisMBP prodbackup-11122021 %

ghost commented 2 years ago

@tamalampudi it looks like the call is failing now on querying the space (id = 2) children. Gazer calls process_space() recursively for all the children of the given parent space. Can you please try to call the following API call directly?

  1. Make a call to get an authorization token curl -i -d "client_id=xxxxxx&client_secret=xxxxxx" https://<your-api-host-and-port>/login
  2. Make a call to get all the child spaces for parent space id = 2 curl -i -H "Authorization: token xxxxxxxxxx" https://<your-api-host-and-port>/api/3.1/spaces/2/children
tamalampudi commented 2 years ago

Please find the attached file for log: logfile.txt

ghost commented 2 years ago

@tamalampudi, thanks for providing the file output, much easier to read!

It appears that there are more than 4300 child spaces under space (id = 2). I'm guessing the timeout issue is related to volume, so I'd like to try some things that @KGoodacre stated were already tried in a prior post, but would like to try again if possible:

  1. Increase the gzr timeout to something big like 10 minutes (600 seconds). This is the quickest/easiest one to try gzr space export 2 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxx' --client-secret='xxxxxx' --timeout=600--debug
  2. Split up the export parent space (id =2) & instead run a gzr export space command for the parent and children spaces individually. This is something you'll need to change in your backup process
tamalampudi commented 2 years ago

Todd,

1) As you suggested we increased the timeout and tested still we see the issue most of the times. 2)we already implemented the spilt up process also still same issue . do you thing gazer is not able to handle the huge data, i mean if data increased. we already gone through all the roots like network admin, infrastructure admin, team city admin from where we are executing scripts etc... but all confirmed there is no change and all good, offcouse it was good before never saw any error. seems while data is getting increased then only issue started, seems gazer not able to handle the huge data. Please let us know your inputs further...

ghost commented 2 years ago

@tamalampudi, one other thing that you can try is the "persistent" flag. I have mixed feelings if it will help, but it's worth a try if you have time. Otherwise, we'll likely need to find a way to reproduce your issue in one of our environments: gzr space export 2 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxx' --client-secret='xxxxxx' --timeout=300 --persistent --debug

KGoodacre commented 2 years ago

@tkofford-bytecode Do you have any suggestions for alternative solutions to "backing up" Looker spaces?

tamalampudi commented 2 years ago

i am getting the below error: (base) SIVANARAYANA.TAMALAMPUDI@sivanarpudismbp prodbackup-11122021 % gzr space export 2 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxxxxx' --client-secret='xxxxxxxx' --timeout=300 --persistent --debug ERROR: "gzr space export" was called with arguments ["2", "--persistent"] Usage: "gzr space export SPACE_ID" (base) SIVANARAYANA.TAMALAMPUDI@sivanarpudismbp prodbackup-11122021 %

ghost commented 2 years ago

@tamalampudi the "persistent" flag is available in the latest version of gazer. Please make sure you are running the latest version of gazer which is v0.2.47: gzr --version If you are not using that version, please update and run the version command again: gem update gazer Once you have the latest version installed, please try to run the command you specified above again (i.e., the one that includes the "persistent" flag). In local testing, I've seen the persistent flag really help network performance a lot, so I think it's still worth trying.

ghost commented 2 years ago

This issue has been marked as "Stale" since there has been no activity for over 2 weeks. It will be closed due to a lack of activity in 7 days.

ghost commented 2 years ago

Closed due to inactivity.

KGoodacre commented 2 years ago

@ghost Which curl call would I make to export an entire space and it’s child contents as well? The Spaces call is being deprecated by Looker.

KGoodacre commented 2 years ago

@tamalampudi, thanks for providing the file output, much easier to read!

It appears that there are more than 4300 child spaces under space (id = 2). I'm guessing the timeout issue is related to volume, so I'd like to try some things that @KGoodacre stated were already tried in a prior post, but would like to try again if possible:

  1. Increase the gzr timeout to something big like 10 minutes (600 seconds). This is the quickest/easiest one to try gzr space export 2 --host='xpologisticsprod.cloud.looker.com' --port='443' --client-id='xxxxxx' --client-secret='xxxxxx' --timeout=600--debug
  2. Split up the export parent space (id =2) & instead run a gzr export space command for the parent and children spaces individually. This is something you'll need to change in your backup process

@ghost We’ve tried this as well and we still run into the timeout issue. I was thinking that we could just use a curl to export and take gazer out of the equation. Would this be possible? If so which Looker API calls would we need to combine in order to replicate the Gazer’s “export” call? I think the root issue is the data size since Gazer is being used to backup an Enterprise’s data. No matter how much we increase the timeout flag; it still fails with a faraday TCP connection error. We split the personal and shared space and tried backing up the child spaces but we still run into the same faraday error. I also tried using the persistent flag and to no avail, the error is still thrown.

vpoiesz commented 2 years ago

Hi @KGoodacre,

The Looker API has renamed "space" to "folder", but in Gazer we are keeping the "space" command for now (and will eventually add "folder" as an alias). If you are having trouble with it please update to the latest version; we did make a fix recently to force calls to the API 3.1 endpoints.

Regarding the timeout errors, I think we have some other work in progress that will help your use case. Here's some background:

Our hope is that this new workflow can remove the need for Gazer in most use cases. We have another project called looker_deployer where we will start using these endpoints for high-level content import/export commands. That project is built with Python so customers tend to have an easier time managing/customizing it.

I can't guarantee this will necessarily handle your scale right at the outset. You'll also have to manage the transition from json formatted backups to yaml. However I think this will put us in a much better position to iterate going forward, since it eliminates the complexity of the Gazer logic and Ruby dependencies. If you can hold out a little while longer, we should have the new endpoints in preview mode in the next release or two.

Please let me know how that sounds to you!