Add better support for logs management

[avishnyakov]

Currently, this provider does not support any of log management features.

It makes it hard to manage and move configurations across different DataDog organizations. Here are several suggestion for new features:

• support column creation
• support facets creation
• support saved views creation

[gregsymons]

DataDog would have to publish APIs for log management first.

[julianvmodesto]

There are Datadog Log Index and Pipeline APIs

https://docs.datadoghq.com/api/?lang=python#logs-indexes https://docs.datadoghq.com/api/?lang=python#logs-pipelines

[NBParis]

Hello,

Thanks @julianvmodesto , we indeed to have an API for pipelines and indexes (which include exclusion filters) and we are working on adding terraform support for it.

Regarding your request, it is planned to have an API and terraform support for:

• Management of Facets and Measures
• Management of Saved Views

Those are being worked on and we will update this thread once released.

Regarding columns, those are per users therefore I'm not sure to understand how you would use an API for them. Would you mind extending on your use case regarding setting columns via API?

[bkabrda]

Hi folks, version 2.5.0 of the provider has been released and contains support for logs indexes and logs pipelines [1]. While I understand that the current feature set does not fully satisfy everything that this issue asks for, I still wanted to give a heads-up here so that you could benefit from these new resources.

[1] https://github.com/terraform-providers/terraform-provider-datadog/blob/master/CHANGELOG.md#250-october-22-2019

[thomas-riccardi]

Hello,

Are there any plans to add "Generate Metrics" from logs support too? (and Distribution Metrics from them?)

Thanks

[NBParis]

Hello @thomas-riccardi ,

The overall plan is to support all features through API and terraform which includes the Generate Metrics from Logs.

We will make sure to update this issue as we make progress on the different items covered here.

[chriskolenko]

Any ETA for managing Facets?

[lukeforehand]

Our company also needs to generate metrics and create facets from terraform. They are the next logical features after finishing datadog_dashboard, since the dashboards require special metrics and facets. On the positive side, we were able to wire our cluster resource names into the dashboard log queries because they are terraformed, BIG WIN!

[egorchabala]

Be able to terrafom facets is must for multi-org setups. I'm interesting to see this feature as well

[drpebcak]

Being able to create facets via terraform would be really great. Is there an ETA on this?

[sanderginn]

Still no news? Facet management in Terraform is important for us.

[pavlospt]

Bumping up this issue, since there is no reply yet! Will Logs -> Saved Views be available through the TF provider? If there is API support I could help with a contribution!

[knowshan]

It has been almost 33 months since this was requested originally. Is there any update on this?

We need Datadog facet management supported through API and Terraform to standardize Datadog account management. As mentioned by lukeforehand in comment, this is necessary even for setting up common Dashboards especially in multiple Datadog accounts.

Note that, there is already internal API for this: https://app.datadoghq.com/api/v1/logs/scopes/{scope_id}/facets?type=logs . Please consider expediting this feature request as it is necessary to support multiple Datadog accounts with set of standard facets and dashboards.

[andyshinn]

Didn't see it already in this thread. But I'd like the ability to create exclusion filters as a separate resource for the index. My use case is allowing different applications and projects to define their own exclusion filters referencing the index by name or ID (so that we can do it on the default main index as well).

[ShajiCsTR]

Is there any update on the facet feature being available

[anietieasuquo]

Any update on the facet and measure feature?

[NBParis]

Hello there,

Just in case this was missed but Facets are no longer required to make searches or analytics. So even if no facets are defined on a given dimension, it can be used in any search or group by in the explorer, dashboards or monitors (anywhere in Datadog).

[pacoguzman]

Any news about supporting facets on the provider?