Closed Adilshaikh8003 closed 3 years ago
Please set debug to true and attach some logs.
User@DESKTOP-99HET08 MINGW64 /cloudinfo (master) $ build/cloudinfo {"application":"cloudinfo","arch":"amd64","build_date":"2020-09-14T17:59:37+0530","commit_hash":"69ce772","compiler":"gc","environment":"production","go_version":"go1.15","level":"info","msg":"starting application","os":"windows","time":"2020-09-14T18:00:19+05:30","version":"0.16.0"} {"application":"cloudinfo","environment":"production","level":"info","msg":"using in-mem cache as product store","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","environment":"production","level":"info","msg":"configured cloud info provider","provider":"google","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","component":"service-manager","environment":"production","level":"info","msg":"triggering cloud information importing ...","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","component":"service-manager","environment":"production","level":"info","msg":"cloud information imported.","time":"2020-09-14T18:00:19+05:30"} [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
[GIN-debug] GET /management/store/export --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/management.(mngmntRouteHandler).Export.func1 (1 handlers) [GIN-debug] PUT /management/store/import --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/management.(mngmntRouteHandler).Import.func1 (1 handlers) [GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.
[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
[GIN-debug] PUT /management/store/refresh/:provider --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/management.(mngmntRouteHandler).Refresh.func1 (1 handlers) [GIN-debug] Listening and serving HTTP on :8001 {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"start scraping for provider information","provider":"google","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","environment":"production","level":"info","msg":"configuring routes","time":"2020-09-14T18:00:19+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"initializing cloud product information","provider":"google","time":"2020-09-14T18:00:19+05:30"} [GIN-debug] GET / --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).ConfigureRoutes.func1 (7 handlers) [GIN-debug] GET /index.html --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).ConfigureRoutes.func2 (7 handlers) [GIN-debug] GET /status --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).signalStatus-fm (7 handlers) [GIN-debug] GET /version --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).versionHandler-fm (7 handlers) [GIN-debug] GET /api/v1/continents --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getContinents.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/ --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getProviders.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getProvider.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getServices.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getService.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/continents --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getContinentsData.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getRegions.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getRegion.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region/images --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getImages.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region/versions --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getVersions.func1 (7 handlers) [GIN-debug] GET /api/v1/providers/:provider/services/:service/regions/:region/products --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(RouteHandler).getProducts.func1 (7 handlers) [GIN-debug] POST /graphql --> github.com/banzaicloud/cloudinfo/internal/app/cloudinfo/api.(*RouteHandler).query.func1 (7 handlers) [GIN-debug] Listening and serving HTTP on :8000 {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"error","msg":"failed to initialize cloud product information","provider":"google","time":"2020-09-14T18:00:24+05:30"} {"application":"cloudinfo","environment":"production","level":"error","msg":"googleapi: Error 403: Cloud Billing API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/cloudbilling.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","time":"2020-09-14T18:00:24+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"start to scrape service region information","provider":"google","service":"compute","time":"2020-09-14T18:00:24+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"info","msg":"start to scrape service region information","provider":"google","service":"gke","time":"2020-09-14T18:00:54+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-northeast1","time":"2020-09-14T18:01:00+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"australia-southeast1","time":"2020-09-14T18:01:02+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west1","time":"2020-09-14T18:01:05+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west3","time":"2020-09-14T18:01:07+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-east1","time":"2020-09-14T18:01:10+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-east4","time":"2020-09-14T18:01:12+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-west1","time":"2020-09-14T18:01:14+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-west2","time":"2020-09-14T18:01:15+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-east1","time":"2020-09-14T18:01:17+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-southeast1","time":"2020-09-14T18:01:19+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-north1","time":"2020-09-14T18:01:21+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west2","time":"2020-09-14T18:01:23+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"us-central1","time":"2020-09-14T18:01:26+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-east2","time":"2020-09-14T18:01:28+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"asia-south1","time":"2020-09-14T18:01:30+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"europe-west4","time":"2020-09-14T18:01:33+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"northamerica-northeast1","time":"2020-09-14T18:01:35+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","error":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","level":"error","msg":"failed to scrape images for region","provider":"google","region":"southamerica-east1","time":"2020-09-14T18:01:37+05:30"} {"application":"cloudinfo","component":"scraping-manager","environment":"production","level":"error","msg":"failed to load service region information","provider":"google","time":"2020-09-14T18:01:37+05:30"} {"application":"cloudinfo","environment":"production","level":"error","msg":"failed to retrieve service versions for region: googleapi: Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled. Enable it by visiting https://console.developers.google.com/apis/api/container.googleapis.com/overview?project=88979237084 then retry. If you enabled this API recently, wait a few minutes for the action to propagate to our systems and retry., accessNotConfigured","provider":"google","region":"southamerica-east1","service":"gke","time":"2020-09-14T18:01:37+05:30"} {"application":"cloudinfo","correlation-id":"14a5e1b6-9dc7-4038-a5e7-e178a59e1685","environment":"production","level":"info","msg":"getting providers","time":"2020-09-14T18:01:45+05:30"} time="2020-09-14T18:01:45+05:30" level=info correlation-id=14a5e1b6-9dc7-4038-a5e7-e178a59e1685 latency="999.2µs" method=GET path=/api/v1/providers/ status=200 [GIN] 2020/09/14 - 18:01:45 | 200 | 999.2µs | ::1 | GET /api/v1/providers/ {"application":"cloudinfo","correlation-id":"ff65ff68-f686-42ac-acaa-5e2724161931","environment":"production","level":"info","msg":"getting regions","provider":"google","service":"compute","time":"2020-09-14T18:01:45+05:30"} time="2020-09-14T18:01:45+05:30" level=info correlation-id=ff65ff68-f686-42ac-acaa-5e2724161931 latency=0s method=GET path=/api/v1/providers/google/services/compute/regions status=200 [GIN] 2020/09/14 - 18:01:45 | 200 | 0s | ::1 | GET /api/v1/providers/google/services/compute/regions {"application":"cloudinfo","correlation-id":"b2a171c9-d83e-4a94-aeeb-e64ac14527ed","environment":"production","level":"info","msg":"getting product details","provider":"google","region":"asia-east2","service":"compute","time":"2020-09-14T18:01:45+05:30"} time="2020-09-14T18:01:45+05:30" level=info correlation-id=b2a171c9-d83e-4a94-aeeb-e64ac14527ed latency=1.9993ms method=GET path=/api/v1/providers/google/services/compute/regions/asia-east2/products status=500 [GIN] 2020/09/14 - 18:01:45 | 500 | 1.9993ms | ::1 | GET /api/v1/providers/google/services/compute/regions/asia-east2/products {"application":"cloudinfo","correlation-id":"e2e95fdd-6ea3-4588-bc74-629c3f553ec9","environment":"production","level":"info","msg":"getting regions","provider":"google","service":"gke","time":"2020-09-14T18:01:51+05:30"} time="2020-09-14T18:01:51+05:30" level=info correlation-id=e2e95fdd-6ea3-4588-bc74-629c3f553ec9 latency=1.999ms method=GET path=/api/v1/providers/google/services/gke/regions status=200 [GIN] 2020/09/14 - 18:01:51 | 200 | 2.9983ms | ::1 | GET /api/v1/providers/google/services/gke/regions {"application":"cloudinfo","correlation-id":"1e680aab-fed1-4da8-bb70-0ec7fe8dd7fa","environment":"production","level":"info","msg":"getting product details","provider":"google","region":"asia-east2","service":"gke","time":"2020-09-14T18:01:51+05:30"} time="2020-09-14T18:01:51+05:30" level=info correlation-id=1e680aab-fed1-4da8-bb70-0ec7fe8dd7fa latency=0s method=GET path=/api/v1/providers/google/services/gke/regions/asia-east2/products status=500 [GIN] 2020/09/14 - 18:01:51 | 500 | 0s | ::1 | GET /api/v1/providers/google/services/gke/regions/asia-east2/products {"application":"cloudinfo","correlation-id":"32c55b92-3e28-4ba4-bdf5-8035f6ee4f11","environment":"production","level":"info","msg":"getting product details","provider":"google","region":"asia-southeast1","service":"gke","time":"2020-09-14T18:01:52+05:30"} time="2020-09-14T18:01:52+05:30" level=info correlation-id=32c55b92-3e28-4ba4-bdf5-8035f6ee4f11 latency="995.9µs" method=GET path=/api/v1/providers/google/services/gke/regions/asia-southeast1/products status=500 [GIN] 2020/09/14 - 18:01:52 | 500 | 995.9µs | ::1 | GET /api/v1/providers/google/services/gke/regions/asia-southeast1/products
Error 403: Kubernetes Engine API has not been used in project 88979237084 before or it is disabled.
Describe the bug We have configured google setup we facing the following issue.
Unable to get google product info. we are facing the below issue. {"type":"about:blank","title":"Internal Server Error","status":500,"detail":"status not yet cached"} We waited for 3-4 hours but still getting the same issue.
http://localhost:8000/api/v1/providers/google/services/compute/regions/asia-east2/products
Steps to reproduce the issue:
Expected behavior
Screenshots
Additional context