[QUESTION] GMD pricing

[winadm87]

YACE version v0.59.0

Config file ` jobs:

• type: AWS/RDS regions: [ eu-west-1 ] delay: 0 period: 60 length: 300 dimensionNameRequirements:

  • DBInstanceIdentifier metrics:
  • name: CPUUtilization statistics: [ Average ]
  • name: DatabaseConnections statistics: [ Average ]
  • name: FreeableMemory statistics: [ Average ]
  • name: ReadLatency statistics: [ Average ]
  • name: WriteLatency statistics: [ Average ]
  • name: DiskQueueDepth statistics: [ Average ]
  • name: FreeStorageSpace statistics: [ Average ]
  • name: BurstBalance statistics: [ Average ]
  • name: CPUCreditBalance statistics: [ Average ] length: 600
  • name: EBSIOBalance% statistics: [ Average ] length: 600
  • name: EBSByteBalance% statistics: [ Average ] length: 600
  • name: WriteIOPS statistics: [ Average ]
  • name: ReadIOPS statistics: [ Average ]

• type: AWS/ApplicationELB regions:

  • eu-west-1
  • eu-central-1
  • us-east-1 delay: 0 period: 60 length: 300 nilToZero: true dimensionNameRequirements:
  • LoadBalancer metrics:
  • name: ClientTLSNegotiationErrorCount statistics: [ Sum ]
  • name: HTTPCode_ELB_4XX_Count statistics: [ Sum ]
  • name: HTTPCode_ELB_5XX_Count statistics: [ Sum ]
  • name: RejectedConnectionCount statistics: [ Sum ]
  • name: NewConnectionCount statistics: [ Sum ]
  • name: RequestCount statistics: [ Sum ]
  • name: TargetResponseTime statistics: [ Average ]

• type: AWS/ApplicationELB regions:

  • eu-west-1
  • eu-central-1
  • us-east-1 delay: 0 period: 60 length: 300 nilToZero: true dimensionNameRequirements:
  • TargetGroup
  • LoadBalancer metrics:
  • name: HealthyHostCount statistics: [ Average ]
  • name: UnHealthyHostCount statistics: [ Average ]
  • name: HTTPCode_Target_4XX_Count statistics: [ Sum ]
  • name: HTTPCode_Target_5XX_Count statistics: [ Sum ]
  • name: TargetConnectionErrorCount statistics: [ Sum ]

• type: AWS/CloudFront regions: [ us-east-1 ] delay: 600 period: 60 length: 60 nilToZero: true dimensionNameRequirements:

  • DistributionId
  • Region metrics:
  • name: Requests statistics: [ Sum ]
  • name: BytesDownloaded statistics: [ Sum ]
  • name: 4xxErrorRate statistics: [ Average ]
  • name: 5xxErrorRate statistics: [ Average ]

• type: AWS/Lambda regions:

  • eu-west-1
  • eu-central-1
  • us-east-1 delay: 0 period: 60 length: 300 nilToZero: true dimensionNameRequirements:
  • FunctionName metrics:
  • name: Invocations statistics: [ Sum ]
  • name: Duration statistics: [ Sum ]
  • name: Throttles statistics: [ Sum ]
  • name: Errors statistics: [ Sum ]

• type: AWS/Firehose regions: [ eu-west-1 ] delay: 0 period: 60 length: 300 nilToZero: true dimensionNameRequirements:

  • DeliveryStreamName metrics:
  • name: DeliveryToS3.DataFreshness statistics: [ Maximum ]
  • name: IncomingBytes statistics: [ Maximum ]
  • name: BytesPerSecondLimit statistics: [ Maximum ]
  • name: IncomingRecords statistics: [ Sum ]
  • name: SucceedProcessingRecords statistics: [ Sum ]
  • name: ThrottledRecords statistics: [ Sum ]
  • name: RecordsPerSecondLimit statistics: [ Maximum ]
  • name: IncomingPutRequests statistics: [ Maximum ]
  • name: PutRequestsPerSecondLimit statistics: [ Maximum ]

• type: AWS/SQS regions: [ eu-west-1 ] delay: 0 period: 60 length: 300 nilToZero: true dimensionNameRequirements:

  • QueueName metrics:
  • name: NumberOfMessagesSent statistics: [ Sum ]
  • name: NumberOfMessagesReceived statistics: [ Sum ]
  • name: ApproximateAgeOfOldestMessage statistics: [ Maximum ]
  • name: ApproximateNumberOfMessagesDelayed statistics: [ Maximum ]

• type: AWS/S3 regions:

  • eu-west-1
  • eu-central-1
  • us-east-1 delay: 0 dimensionNameRequirements:
  • StorageType
  • BucketName metrics:
  • name: BucketSizeBytes statistics: [ Average ] period: 86400 length: 172800
  • name: NumberOfObjects statistics: [ Average ] period: 86400 length: 259200 `

Current Behavior Assume we run yace with "--scraping-interval=60" parameter with the specified config above. In such configuration GMD pricing gives about 6 dollars overhead daily comparing with the basic java cw exporter with the same config and GetMetricStatistics, which have 1kk free-tier API calls monthly. On some comprehensive configs we can observe about 30 dollars daily overhead.

Expected Behavior

Steps To Reproduce Run yace exporter with any config, than run java cw exporter with the same resources/dimension/metrics specified and compare pricing.

Anything else? We wonder if such pricing overhead is expected behavior? Why the pricing information/comparisions are not specified in exporter readme? What else can be done to cost cut, except of reducing scraping interval and narrowing down list of scraping resources?