banzaicloud / cloudinfo

Cloud instance type and price information as a service
https://banzaicloud.com/cloudinfo
Apache License 2.0
165 stars 36 forks source link

Google Productinfo api error #378

Closed Adilshaikh8003 closed 3 years ago

Adilshaikh8003 commented 3 years ago

Describe the bug We have configured google setup we facing the following issue.

Unable to get google product info. we are facing the below issue. {"type":"about:blank","title":"Internal Server Error","status":500,"detail":"status not yet cached"} We waited for 3-4 hours but still getting the same issue.

http://localhost:8000/api/v1/providers/google/services/compute/regions/asia-east2/products

Steps to reproduce the issue:

Expected behavior

Screenshots

Additional context

sagikazarmark commented 3 years ago

Please set debug to true and attach some logs.

Adilshaikh8003 commented 3 years ago

User@DESKTOP-99HET08 MINGW64 /cloudinfo (master) $ build/cloudinfo {"application":"cloudinfo","arch":"amd64","build_date":"2020-09-14T17:59:37+0530","commit_hash":"69ce772","compiler":"gc","environment":"production","go_version":"go1.15","level":"info","msg":"starting application","os":"windows","time":"2020-09-14T18:00:19+05:30","version":"0.16.0"} {"application":"cloudinfo","environment":"production","level":"info","msg":"using in-mem cache as product store","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","environment":"production","level":"info","msg":"configured cloud info provider","provider":"google","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","component":"service-manager","environment":"production","level":"info","msg":"triggering cloud information importing ...","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","component":"service-manager","environment":"production","level":"info","msg":"cloud information imported.","time":"2020-09-14T18:00:19+05:30"} [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.

[GIN-debug] GET /management/store/export --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/management.(mngmntRouteHandler).Export.func1 (1 handlers) [GIN-debug] PUT /management/store/import --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/management.(mngmntRouteHandler).Import.func1 (1 handlers) [GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.

[GIN-debug] PUT /management/store/refresh/:provider --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/management.(mngmntRouteHandler).Refresh.func1 (1 handlers) [GIN-debug] Listening and serving HTTP on :8001 {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"start scraping for provider information","provider":"google","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","environment":"production","level":"info","msg":"configuring routes","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"initializing cloud product information","provider":"google","time":"2020-09-14T18:00:19+05:30"} [GIN-debug] GET / --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).ConfigureRoutes.func1 (7 handlers) [GIN-debug] GET /index.html --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).ConfigureRoutes.func2 (7 handlers) [GIN-debug] GET /status --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).signalStatus-fm (7 handlers) [GIN-debug] GET /version --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).versionHandler-fm (7 handlers) [GIN-debug] GET /api/v1/continents --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getContinents.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/ --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getProviders.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getProvider.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getServices.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getService.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/continents --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getContinentsData.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getRegions.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getRegion.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region/images --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getImages.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region/versions --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getVersions.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region/products --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getProducts.func1 (7 handlers) [GIN-debug] POST /graphql --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(*RouteHandler).query.func1 (7 handlers) [GIN-debug] Listening and serving HTTP on :8000 {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"error","msg":"failed to initialize cloud product information","provider":"google","time":"2020-09-14T18:00:24+05:30"} {"application":"cloudinfo","environment":"production","level":"error","msg":"googleapi: Error 403: Cloud Billing API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/cloudbilling.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","time":"2020-09-14T18:00:24+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"start to scrape service region information","provider":"google","service":"compute","time":"2020-09-14T18:00:24+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"start to scrape service region information","provider":"google","service":"gke","time":"2020-09-14T18:00:54+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-northeast1","time":"2020-09-14T18:01:00+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"australia-southeast1","time":"2020-09-14T18:01:02+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west1","time":"2020-09-14T18:01:05+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west3","time":"2020-09-14T18:01:07+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-east1","time":"2020-09-14T18:01:10+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-east4","time":"2020-09-14T18:01:12+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-west1","time":"2020-09-14T18:01:14+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-west2","time":"2020-09-14T18:01:15+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-east1","time":"2020-09-14T18:01:17+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-southeast1","time":"2020-09-14T18:01:19+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-north1","time":"2020-09-14T18:01:21+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west2","time":"2020-09-14T18:01:23+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-central1","time":"2020-09-14T18:01:26+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-east2","time":"2020-09-14T18:01:28+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-south1","time":"2020-09-14T18:01:30+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west4","time":"2020-09-14T18:01:33+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"northamerica-northeast1","time":"2020-09-14T18:01:35+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"southamerica-east1","time":"2020-09-14T18:01:37+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"error","msg":"failed to load service region information","provider":"google","time":"2020-09-14T18:01:37+05:30"} {"application":"cloudinfo","environment":"production","level":"error","msg":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","provider":"google","region":"southamerica-east1","service":"gke","time":"2020-09-14T18:01:37+05:30"} {"application":"cloudinfo","correlation-id":"14a5e1b6-9dc7-4038-a5e7-e178a59e1685","environment":"production","level":"info","msg":"getting providers","time":"2020-09-14T18:01:45+05:30"} time="2020-09-14T18:01:45+05:30" level=info correlation-id=14a5e1b6-9dc7-4038-a5e7-e178a59e1685 latency="999.2µs" method=GET path=/api/v1/providers/ status=200 [GIN] 2020/09/14 - 18:01:45 | 200 | 999.2µs | ::1 | GET /api/v1/providers/ {"application":"cloudinfo","correlation-id":"ff65ff68-f686-42ac-acaa-5e2724161931","environment":"production","level":"info","msg":"getting regions","provider":"google","service":"compute","time":"2020-09-14T18:01:45+05:30"} time="2020-09-14T18:01:45+05:30" level=info correlation-id=ff65ff68-f686-42ac-acaa-5e2724161931 latency=0s method=GET path=/api/v1/providers/google/services/compute/regions status=200 [GIN] 2020/09/14 - 18:01:45 | 200 | 0s | ::1 | GET /api/v1/providers/google/services/compute/regions {"application":"cloudinfo","correlation-id":"b2a171c9-d83e-4a94-aeeb-e64ac14527ed","environment":"production","level":"info","msg":"getting product details","provider":"google","region":"asia-east2","service":"compute","time":"2020-09-14T18:01:45+05:30"} time="2020-09-14T18:01:45+05:30" level=info correlation-id=b2a171c9-d83e-4a94-aeeb-e64ac14527ed latency=1.9993ms method=GET path=/api/v1/providers/google/services/compute/regions/asia-east2/products status=500 [GIN] 2020/09/14 - 18:01:45 | 500 | 1.9993ms | ::1 | GET /api/v1/providers/google/services/compute/regions/asia-east2/products {"application":"cloudinfo","correlation-id":"e2e95fdd-6ea3-4588-bc74-629c3f553ec9","environment":"production","level":"info","msg":"getting regions","provider":"google","service":"gke","time":"2020-09-14T18:01:51+05:30"} time="2020-09-14T18:01:51+05:30" level=info correlation-id=e2e95fdd-6ea3-4588-bc74-629c3f553ec9 latency=1.999ms method=GET path=/api/v1/providers/google/services/gke/regions status=200 [GIN] 2020/09/14 - 18:01:51 | 200 | 2.9983ms | ::1 | GET /api/v1/providers/google/services/gke/regions {"application":"cloudinfo","correlation-id":"1e680aab-fed1-4da8-bb70-0ec7fe8dd7fa","environment":"production","level":"info","msg":"getting product details","provider":"google","region":"asia-east2","service":"gke","time":"2020-09-14T18:01:51+05:30"} time="2020-09-14T18:01:51+05:30" level=info correlation-id=1e680aab-fed1-4da8-bb70-0ec7fe8dd7fa latency=0s method=GET path=/api/v1/providers/google/services/gke/regions/asia-east2/products status=500 [GIN] 2020/09/14 - 18:01:51 | 500 | 0s | ::1 | GET /api/v1/providers/google/services/gke/regions/asia-east2/products {"application":"cloudinfo","correlation-id":"32c55b92-3e28-4ba4-bdf5-8035f6ee4f11","environment":"production","level":"info","msg":"getting product details","provider":"google","region":"asia-southeast1","service":"gke","time":"2020-09-14T18:01:52+05:30"} time="2020-09-14T18:01:52+05:30" level=info correlation-id=32c55b92-3e28-4ba4-bdf5-8035f6ee4f11 latency="995.9µs" method=GET path=/api/v1/providers/google/services/gke/regions/asia-southeast1/products status=500 [GIN] 2020/09/14 - 18:01:52 | 500 | 995.9µs | ::1 | GET /api/v1/providers/google/services/gke/regions/asia-southeast1/products

sagikazarmark commented 3 years ago

Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled.