ArchiFleKs
commented
2 years ago @ramesh-kumarjha Could you post more readable logs please, with ``` like this:
thanos = {
enabled = true
generate_ca = true
bucket_force_destroy = true
}Also do you have the logs of the thanos storegateway, and did you check the webUI of the thanos query component to this if it was correctly connected to all the other thanos store ?
k -n monitoring port-forward thanos-query-687f8bb88d-fjgh5 10902 for example, you should see the different store that connect to thanos query. If the store is not here, check first the logs of the storage pods, then the target discovery on the thanos query web UI
ramesh-kumarjha
Only 2 hour data is visible in grafna dashbord i have checked promethus also getting only 2 hour of data . And data is pushed to s3 bucket my terragrunt.hcl file in eks-adons folder is include { path = "${find_in_parent_folders()}" }
terraform { source = "github.com/particuleio/terraform-kubernetes-addons.git//modules/aws?ref=v2.1.0" }
dependency "eks" { config_path = "../eks"
mock_outputs = { cluster_id = "cluster-name" cluster_oidc_issuer_url = "https://oidc.eks.eu-west-3.amazonaws.com/id/0000000000000000" } }
dependency "vpc" { config_path = "../vpc"
mock_outputs = { private_subnets_cidr_blocks = [ "privateip.cidr", "privateip.cidr" ] } }
generate "provider" { path = "provider.tf" if_exists = "overwrite" contents = <<-EOF provider "aws" { region = "${local.aws_region}" } provider "kubectl" { host = data.aws_eks_cluster.cluster.endpoint cluster_ca_certificate = base64decode(data.aws_eks_cluster.cluster.certificate_authority.0.data) token = data.aws_eks_cluster_auth.cluster.token load_config_file = false } provider "kubernetes" { host = data.aws_eks_cluster.cluster.endpoint cluster_ca_certificate = base64decode(data.aws_eks_cluster.cluster.certificate_authority.0.data) token = data.aws_eks_cluster_auth.cluster.token } provider "helm" { kubernetes { host = data.aws_eks_cluster.cluster.endpoint cluster_ca_certificate = base64decode(data.aws_eks_cluster.cluster.certificate_authority.0.data) token = data.aws_eks_cluster_auth.cluster.token } } data "aws_eks_cluster" "cluster" { name = var.cluster-name } data "aws_eks_cluster_auth" "cluster" { name = var.cluster-name } EOF }
locals { aws_region = yamldecode(file("${find_in_parent_folders("region_values.yaml")}"))["aws_region"] custom_tags = merge( yamldecode(file("${find_in_parent_folders("global_tags.yaml")}")), yamldecode(file("${find_in_parent_folders("env_tags.yaml")}")) ) default_domain_name = yamldecode(file("${find_in_parent_folders("global_values.yaml")}"))["default_domain_name"] default_domain_suffix = "${local.custom_tags["Env"]}.${local.custom_tags["Project"]}.${local.default_domain_name}" }
inputs = {
cluster-name = dependency.eks.outputs.cluster_id
tags = merge( local.custom_tags )
eks = { "cluster_oidc_issuer_url" = dependency.eks.outputs.cluster_oidc_issuer_url }
aws-ebs-csi-driver = { enabled = true is_default_class = true }
aws-for-fluent-bit = { enabled = true }
test this with nginx controller
aws-load-balancer-controller = { enabled = true }
aws-node-termination-handler = { enabled = false }
calico = { enabled = true }
cert-manager = { enabled = false acme_email = "xyz@gmail.com" acme_http01_enabled = true acme_http01_ingress_class = "nginx" acme_dns01_enabled = true allowed_cidrs = dependency.vpc.outputs.private_subnets_cidr_blocks experimental_csi_driver = true }
cluster-autoscaler = { enabled = true }
cni-metrics-helper = { enabled = false }
external-dns = { external-dns = { enabled = true }, }
ingress-nginx = { enabled = true use_l7 = true allowed_cidrs = dependency.vpc.outputs.private_subnets_cidr_blocks }
istio-operator = { enabled = false }
karma = { enabled = false }
keycloak = { enabled = false }
kong = { enabled = false }
kube-prometheus-stack = { enabled = true allowed_cidrs = dependency.vpc.outputs.private_subnets_cidr_blocks thanos_sidecar_enabled = true thanos_bucket_force_destroy = true extra_values = <<-EXTRA_VALUES grafana: deploymentStrategy: type: Recreate ingress: enabled: true
paths:
}
loki-stack = { enabled = false bucket_force_destroy = true }
metrics-server = { enabled = true allowed_cidrs = dependency.vpc.outputs.private_subnets_cidr_blocks }
npd = { enabled = false }
sealed-secrets = { enabled = false }
thanos = { enabled = true generate_ca = true bucket_force_destroy = true }
}
thanos sidecar --prometheus.url=http://127.0.0.1:9090/
thanos query
thanos store
could you please help me out because this running on prod env in eks cluster in Grafana datsource is promethus and url is http://thanos-query-frontend:9090