AWS: Collect metrics from multiple profiles

[Pokom]

Overview

Our AWS module was built with the intention of only collecting data for a single profile. As usage as grown and our users needs have changed, we need a way to collect metrics from multiple AWS profiles. When launching cloudcost-exporter we need a way to

• specify single profile to collect metrics for OR
• specify single role ARN to use to for authentication
• specify list of role ARN's to use for authentication

This is a fundamental change to how we generate clients with AWS and will require a proof of concept to help inform how to migrate the codebase over. Ideally we should support the current authentication model while allowing us to opt into adopting using role ARN's for authentication. Once both are available, an end user should be able to chose one or the other, but not both authentication mechanisms.

Documentation

Yace:

• accepts configuration
• client generation

AWS SDK:

• sts creds
• github issue describing problem

Goals

• [ ] Create a POC in the scripts directory to demonstrate collecting ec2 instances from many profiles

[Pokom]

@Pokom will drop my notes here and then likely pivot to deployment per profile.