Deploy Kibana Dashboards in airship-core/multi-tenant types

[lb4368]

Proposed change Provide a demonstration of a Kibana dashboard that includes logs from elasticsearch as part of an airship-core and multi-tenant site deployment.

MVP requirements:

1. Functioning lma-stack composite
   • Create LMA-stack composite in airshipit/treasuremap · Issue #61 · airshipit/treasuremap (github.com)
2. Functioning elastic-stack composite
   • Create airshipit/treasuremap Function for Elasticsearch · Issue #52 · airshipit/treasuremap (github.com)
   • Includes basic pod / system logs
   • All composite overrides
3. Elasticsearch function
   • Create airshipit/treasuremap Function for Elasticsearch · Issue #52 · airshipit/treasuremap (github.com)
4. Kibana Function
   • Create airshipit/treasuremap Function for Kibana · Issue #53 · airshipit/treasuremap (github.com)
   • Dashboard is accessible via nodeport
   • Dashboard showcases data from Elasticsearch

[StevTheDev]

Hey @lb4368, please assign this one to me!

[lb4368]

Done. Thanks @StevTheDev !

[StevTheDev]

These PS have been merged, which brings us closer to completing this epic.

Treasuremap Elasticsearch & Kibana Add elasticsearch-exporter to our elastic-stack

I have a few PS still outstanding which will help close this out:

• [merged] Remove Minio Components from airship-core lma Relates to #111

• Update lma in airship-core type updates the phase structure for LMA - incorporating the system into the airship-core workload and workload-config phases

• Add lma to multi-tenant reference site. This change incorporates the LMA composites in with the lma sub-cluster workload and workload-config phases. Also it adds the lma-infra composite to the target cluster, and configures it to send logs up to the lma-subcluster elasticsearch.

[StevTheDev]

Those last two patchsets were getting too big to be easily reviewed, so I broke them down into smaller pieces:

• 794370: Fix up validation errors from LMA functions
• 793106: Update lma in airship-core type
• 793068: Add LMA to multi-tenant type and reference site lma sub-cluster
• 794394: Add LMA to multi-tenant target cluster

These are all pending review now. T-Shirt size for this item could still be considered M, because most of the development is complete, or bumped up to L due to the scope involved.

[StevTheDev]

Most of the patchsets associated with this feature have merged, but some things are not quite right in the implementation of the replacement transformers:

• 799090: Fix typo in kind and fix replacement transformer merged.
• 799749: Add some and fix other LMA Versions Replacements

[eak13]

@StevTheDev looks like those 2 patchsets merged (799090 & 799749). Can we close this issue now? Thanks.

[eak13]

Closing per code merges.