search

simatec / ioBroker.backitup

ioBroker.backitup allows you to backup and restore your ioBroker installation and other systems, such as databases, Zigbee, scripts and many more.
MIT License
68 stars 35 forks source link

Grafana backup does not contain all data (Dashboard Folders and Alerts are missing) #1131

Open Andi-82 opened 3 months ago

Andi-82 commented 3 months ago

Describe the bug
The Backup of the Grafana 11 is not complete. Grafana Backup is running normally, but the backup does not contain the information about folders with Dashboards. This will be shown after the restore was done on a new Hardware. Also the alerts are missing there.

To Reproduce
Steps to reproduce the behavior:

  1. Go to 'Create and restore a Backup of Grafana'
  2. Click on 'Grafana page -> Home -> Dashboard -> Folder View'
  3. Scroll down to 'Dashboard Folders which are not existing, just Dashboards visible, one of them with the same name as the foldername is expected.'
  4. See error

Expected behavior
I would expect that all the "Dashboard folders" and also the "Alerts" of the "old" system (Grafana 11) are existing after the restore also in the new system.

Screenshots & Logfiles
If applicable, add screenshots and logfiles to help explain your problem.

Versions:

Additional context
Add any other context about the problem here.

simatec commented 3 months ago

Please check the contents of the backup file. The content should look like this: image

The "dashboards" directory contains the files for the restore via Backitup and "dashboards_manuelly_restore" contains the individual dashboards as json for direct insertion into Grafana.

Andi-82 commented 3 months ago

Thanks for your reply. That is correct and I can found all my Dashboards, only the folders will not be created as a folder when I import the json files. (See screenshot attached)

After import (restore) the backuped json file: 20240618_171220.jpg

Original folder before backup and restore: 20240618_171205.jpg

May the type is set up as dashboard instead of folder?!

simatec commented 3 months ago

Unfortunately, I don't understand your issue. Have the dashboards been restored or not? What exactly is missing?

Please explain in more detail and show the contents of the backup file and the log from the restore of the Grafana backup

Andi-82 commented 3 months ago

Unfortunately, I don't understand your issue. Have the dashboards been restored or not? What exactly is missing?

Please explain in more detail and show the contents of the backup file and the log from the restore of the Grafana backup

To reproduce this issue the following steps needs to be done: 1) Grafana backup created with iobroker adpter Backitup on a Raspberry 2) Transfer the created backupfile to the new installed iobroker and grafana instance 3) Restore the backup of iobroker and grafana -> works fine, just the dashboard folder structure, which contains also the dashboards (see my screenshots above from the grafana web page :3000) where not created correctly.

The dashboard which where located in this dashboard folder "IT" are just located below the "General" folder instead of my "IT" folder now. (Screenshot folder "IT")

In my mind the dashboards (on the grafana web page), which were located in the IT folder, should be also below this one there after the restore.

The structure before locked like:

The folder/dashboard structure after restore:

(See also screenshots above)

In the restore logs were no warnings or errors shown.

simatec commented 3 months ago

Which Grafana version was on the PI and which is installed on the new system?

Is the directory name included in the json files in the backup file?

What happens if you manually restore the json of a dashboard?

Andi-82 commented 3 months ago

Which Grafana version was on the PI and which is installed on the new system? -> on both system is the version 11.0.0 in use

Is the directory name included in the json files in the backup file? -> which directory name do mean? Im always talking about the folder on the grafana web page.

What happens if you manually restore the json of a dashboard? -> if I import the json files the dashboards will be shown correctly, but the folder structure to move similar dashboards into one folder will not be shown as a folder.

simatec commented 3 months ago

Which Grafana version was on the PI and which is installed on the new system? -> on both system is the version 11.0.0 in use

and PI?

Is the directory name included in the json files in the backup file? -> which directory name do mean? Im always talking about the folder on the grafana web page.

Grafana folder

What happens if you manually restore the json of a dashboard? -> if I import the json files the dashboards will be shown correctly, but the folder structure to move similar dashboards into one folder will not be shown as a folder.

Please test manually

Andi-82 commented 3 months ago

Which Grafana version was on the PI and which is installed on the new system? -> on both system is the version 11.0.0 in use

and PI? ---> as already written also 11.0.0

Is the directory name included in the json files in the backup file? -> which directory name do mean? Im always talking about the folder on the grafana web page.

Grafana folder

What happens if you manually restore the json of a dashboard? -> if I import the json files the dashboards will be shown correctly, but the folder structure to move similar dashboards into one folder will not be shown as a folder.

Please test manually ---> Now I did copy the grafana folders (/lib/grafana and /lib/grafana) from the directory to the new system with the same rights. The grafana dashbord folder (on the web page ip:3000) will be shown correct. For this reason ot looks like that there is a wrong command in the backitup adapter for grafana)

simatec commented 2 months ago

I don't see it that way. Copying folders within systems is not a good idea. You should show me the contents of a json file from the backup file and test a manual restore of a json.

For this purpose, a separate folder is created in the backup.

If you can't give me more information than what you have already written, I'm afraid I can't understand anything.

Andi-82 commented 2 months ago

If you mean with manual restore of the json to import them via the grafical import function directly in the grafana webpage (:3000). This showed the same result. So maybe there is the export instead of the import the problem.

The json files wich shall contain the dashboard collection folder in grafana contains the following lines: { "id": null, "schemaVersion": 17, "title": "IT", "uid": "bdl3wxton0hkwb", "version": 1 } it.json

The ones which shall be in this folder are attached, because they are quite big. energiebedarf-it-equipment.json netzwerkanalyse.json

I hope they are helpful.

simatec commented 2 months ago

I will try to recreate it