taosdata / grafanaplugin

TDengine datasource plugin for grafana
GNU Affero General Public License v3.0
62 stars 30 forks source link

Grafana Plugin for TDengine

TDengine is open-sourced big data platform under GNU AGPL v3.0, designed and optimized for the Internet of Things (IoT), Connected Cars, Industrial IoT, and IT Infrastructure and Application Monitoring, developed by TDengine.

TDengine data source plugin is developed for Grafana. This document explains how to install and configure the data source plugin, and use it as a time-series database. We'll take a look at the data source options, variables, querying, and other options specific to this data source.

At first, please refer to Add a data source for instructions on how to add a data source to Grafana. Note that, only users with the organization admin role can add data sources.

To install this plugin, please refer to Install the Grafana Plugin for TDengine

Usage

Now it's ready for you to add your own TDengine data source and use it in a dashboard. Refer to Grafana Datasource documentations topic - Add a data source for a quick view. Please make sure the TDengine backend daemon taosd and TDengine RESTful service backend daemon taosadapter already launched.

Add Data Source

Point to Configurations -> Data Sources menu and then Add data source button.

add data source button

Search and choose TDengine. add data source

If TDengine is not in the list, please check the installation instructions for allowing loading unsigned plugins.

Configure TDengine data source for Grafana version 11. data source configuration Note:

  1. Close the Load TDengine Alert button to prevent automatic import of alert rules when adding data sources.
  2. When deleting a data source, it is necessary to first clear the imported alert rules

Configure TDengine data source for Grafana with version lower than 11.

data source configuration

Save and test it, it should say 'TDengine Data source is working'.

data source test

Import Dashboard

Point to + / Create - import (or /assets/import url).

import dashboard and config

Now you can import dashboard with JSON file or grafana dashboard id (please make sure your network is public to https://grafana.com).

Here is the first grafana dashboard you want to use for TDengine, the grafana dashboard id is 18180.

import via grafana.com

After import:

dashboard display

Important changes

v3.6.0

  1. Grafana 11 versions

    The TDengine data source plugin has added functionality for Grafana 11 versions, which can automatically import and clear alerts for basic metrics of the TDengine cluster (such as CPU, memory, dnode, vnode, etc.) when adding data sources. data source configuration Note:

    (1)Close the Load TDengine Alert button to prevent automatic import of alert rules when adding data sources.

    (2)When deleting a data source, it is necessary to first clear the imported alarm rules.

    After adding the data source, you will see the automatically imported alert configuration in the alert management menu. data source configuration

  2. Grafana 7.5 versions

    The TDengine data source plugin has added functionality for Grafana 7.5 versions, which can automatically import and clear alerts for basic metrics of the TDengine cluster (such as CPU, memory, dnode, vnode, etc.) when adding data sources.

    To import the Dashboard, enter "TDinsight for 3.x Dashboard" and click save. Subsequently, the loaded alert rules will appear in the alert menu as shown below. Grafana 7.5

v3.2.0

  1. TDengine data source plugin uses secureJsonData to store sensitive data. It will cause a breaking change when you're upgrading from an older version:

    The simple way to migrate from older version is to reconfigure the data source like adding a data source from scratch.

    If you're using Grafana provisioning configurations, you should change the data source provisioning configuration file to use secureJsonData:

    apiVersion: 1
    datasources:
      # <string, required> name of the datasource. Required
    - name: TDengine
      # <string, required> datasource type. Required
      type: tdengine-datasource
      # <string, required> access mode. direct or proxy. Required
      # <int> org id. will default to orgId 1 if not specified
      orgId: 1
    
      # <string> url to TDengine rest api, eg. http://td1:6041
      url: "$TDENGINE_API"
    
      # <bool> mark as default datasource. Max one per org
      isDefault: true
    
      # <map> 
      secureJsonData:
        # <string> a redundant url configuration. Required.
        url: "$TDENGINE_API"
        # <string> basic authorization token. Required, can be build like
        #   `printf root:taosdata|base64`
        basicAuth: "${TDENGINE_BASIC_AUTH}"
        # <string> cloud service token of TDengine,  optional.
        token: "$TDENGINE_CLOUD_TOKEN"
    
      version: 1
      # <bool> allow users to edit datasources from the UI.
      editable: true
  2. Now users can quickly import TDinsight dashboard in Dashboards tab in a datasource configuration page.

    import-tdinsight-from-tdengine-ds

Monitor TDengine Database with TDengine Data Source Plugin

See How to Monitor TDengine Cluster with Grafana for the details.

TDinsight

TDinsight is a simple monitoring solution for TDengine database. See TDinsight README for the details.

Docker Stack

For a quick look and test, you can use docker-compose to start a full Grafana + AlertManager + Alert Webhook stack:

docker-compose up -d

Services:

Dashboards

You can get other dashboards in the examples' directory, or search in grafana with TDengine datasource https://grafana.com/grafana/dashboards/?orderBy=downloads&direction=desc&dataSource=tdengine-datasource .

Here is a short list:

You could open a pr to add one if you want to share your dashboard with TDengine community, we appreciate your contribution!