Dashboard for the Tiers storage

[razaahmed]

I would like to request a dashboard for the Tiers storage showing Hot/Cold data usage trand

[tymercer]

seconded, would be super useful

[rahulguptajss]

@razaahmed @tymercer Would displaying the output of the following commands in a dashboard, both at the aggregate and volume levels, be helpful for this feature?

aggr show-space -fields performance-tier-inactive-user-data,performance-tier-inactive-user-data-percent
volume show -fields performance-tier-inactive-user-data,performance-tier-inactive-user-data-percent

Reference:

• https://kb.netapp.com/on-prem/ontap/DM/FabricPool/FabricPool-KBs/How_does_FabricPool_inactive_data_reporting_work
• https://docs.netapp.com/us-en/ontap/fabricpool/determine-data-inactive-reporting-task.html#procedure

[razaahmed]

Thanks for looking into this. Personally, I would like to capture the following:

aggr show-space -fields aggregate-size,physical-used,physical-used-percent,performance-tier-inactive-user-data,performance-tier-inactive-user-data-percent,object-store-logical-used,object-store-physical-used

for the volume, vol show doesn't give you details on "used in local tier, and "used in cloud tier" info, otherwise that would be a great addtion

[rahulguptajss]

Thanks @razaahmed . We'll add these.

[rahulguptajss]

@razaahmed This information has been added to the Aggregate Dashboard. You can try the nightly build and share your feedback..

[razaahmed]

Thanks for the update. hopefully will be able to try it soon

[razaahmed]

Thanks @rahulguptajss I just upgraded to 24.06.27-nightly. It works for me except I see "no data" on aggregates by logical space used in object store and aggregates by physical space usage in object store.

[rahulguptajss]

@razaahmed There is an issue with these metrics. We'll fix and update here.

[rahulguptajss]

@razaahmed Could you share output of below curl with us via email @ ng-harvest-files@netapp.com

Please note that the USERNAME, PASSWORD, URL should be replaced with the appropriate credentials.

curl -s -k -u USERNAME:PASSWORD 'https://URL/api/private/cli/aggr/show-space?return_records=true&fields=object_store_logical_used,object_store_physical_used,bin_num,tier_name'

[rahulguptajss]

@razaahmed Could you share output of below curl with us via email @ ng-harvest-files@netapp.com

Please note that the USERNAME, PASSWORD, URL should be replaced with the appropriate credentials.

curl -s -k -u USERNAME:PASSWORD 'https://URL/api/private/cli/aggr/show-space?return_records=true&fields=object_store_logical_used,object_store_physical_used,bin_num,tier_name'

@razaahmed Could you share output of this Rest API.

[razaahmed]

@razaahmed Could you share output of below curl with us via email @ ng-harvest-files@netapp.com Please note that the USERNAME, PASSWORD, URL should be replaced with the appropriate credentials.

curl -s -k -u USERNAME:PASSWORD 'https://URL/api/private/cli/aggr/show-space?return_records=true&fields=object_store_logical_used,object_store_physical_used,bin_num,tier_name'

@razaahmed Could you share output of this Rest API.

I am getting error: 404 page not found

[cgrinds]

@razaahmed what version of ONTAP is your cluster?

[razaahmed]

9.11, 9.12 and 9.13

[cgrinds]

That CLI command should be there for 9.11, as shown below. Let's make sure that REST is enabled for the cluster that returned a 404.

Does this work? Replace ip, user, and pass.

curl -s -k -u $user:$pass 'https://$ip/api/cluster?return_records=true&fields=version,name'

{
  "name": "umeng-aff300-01-02",
  "version": {
    "full": "NetApp Release Mightysquirrel__9.15.1: Fri May 24 05:03:10 UTC 2024",
    "generation": 9,
    "major": 15,
    "minor": 1
  },
  "_links": {
    "self": {
      "href": "/api/cluster"
    }
  }
}

curl -s -k -u $user:$pass 'https://$ip/api/private/cli/aggr/show-space?return_records=true&fields=object_store_logical_used,object_store_physical_used,bin_num,tier_name'

{
  "records": [
    {
      "aggregate_name": "aggr0",
      "bin_num": 0,
      "tier_name": " "
    },
    {
      "aggregate_name": "aggr0_umeng_aff300_02_0",
      "bin_num": 0,
      "tier_name": " "
    },
    {
      "aggregate_name": "test1",
      "bin_num": 0,
      "tier_name": "Performance Tier"
    },
    {
      "aggregate_name": "test1",
      "bin_num": 1,
      "tier_name": "Object Store: sg-ontap1",
      "object_store_physical_used": 0,
      "object_store_logical_used": 0
    },
    {
      "aggregate_name": "umeng_aff300_aggr2",
      "bin_num": 0,
      "tier_name": " "
    }
  ],
  "num_records": 5
}

[razaahmed]

I miss understood. I was pointing to grafana instead of filer. here is the output

sical_used,bin_num,tier_name' { "records": [ { "aggregate_name": "aggr0_01_root", "bin_num": 0, "tier_name": " " }, { "aggregate_name": "aggr0_02_root", "bin_num": 0, "tier_name": " " }, { "aggregate_name": "aggr1", "bin_num": 0, "tier_name": "Performance Tier" }, { "aggregate_name": "aggr1", "bin_num": 1, "tier_name": "Object Store: local_ontap_s3", "object_store_physical_used": 35144895150624, "object_store_logical_used": 35360459766176 }, { "aggregate_name": "aggr2", "bin_num": 0, "tier_name": "Performance Tier" }, { "aggregate_name": "aggr2", "bin_num": 1, "tier_name": "Object Store: local_ontap_s3", "object_store_physical_used": 97797447724128, "object_store_logical_used": 98622360153376 } ], "num_records": 6

[rahulguptajss]

@razaahmed Fix is available in nightly build. Could you please check if issue is fixed now? Thanks.

[Hardikl]

Tested in 24.08 with commit 0a2d140c