chaoss / grimoirelab

GrimoireLab: platform for software development analytics and insights
https://chaoss.github.io/grimoirelab/
GNU General Public License v3.0
494 stars 183 forks source link

No dashboard shown in kibiter #706

Open Eroyi opened 3 days ago

Eroyi commented 3 days ago

image

Not sure which component is responsible for importing dashboards but

GET _cat/indices

image

setup.cfg and projects.json are the sample files provided in grimoirelab/default-grimoirelab-settings.

zhquan commented 2 days ago

Hi @Eroyi

You can use kidash to import the dashboards stored at sigils.

Eroyi commented 1 day ago

Hi @Eroyi

You can use kidash to import the dashboards stored at sigils.

None of the dashboards were able to import into Opensearch-dashboard:

kidash -g -e https://admin:admin@172.16.46.148:9200 --import /tmp/grimoirelab-sigils/panels/json/about.json 

2024-10-25 15:51:55,494 Debug mode activated
2024-10-25 15:51:55,494 Reading panels JSON file: /tmp/grimoirelab-sigils/panels/json/about.json
2024-10-25 15:51:55,494 Reading panel from directory: /tmp/grimoirelab-sigils/panels/json/about.json
2024-10-25 15:51:55,494 Panel detected.
2024-10-25 15:51:56,709 Cleaning dashboard from studies vis
Traceback (most recent call last):
  File "/root/.cache/pypoetry/virtualenvs/kidash-PX08pWr7-py3.12/bin/kidash", line 6, in <module>
    sys.exit(main())
             ^^^^^^
  File "/tmp/grimoirelab-kidash/kidash/bin/kidash.py", line 39, in main
    import_dashboard(args.elastic_url, args.kibana_url, args.import_file, args.kibana_index,
  File "/tmp/grimoirelab-kidash/kidash/kidash.py", line 1297, in import_dashboard
    feed_dashboard(json_to_import, elastic_url, kibana_url, es_index, data_sources, add_vis_studies)
  File "/tmp/grimoirelab-kidash/kidash/kidash.py", line 1457, in feed_dashboard
    import_item_json(elastic, "dashboard", dashboard['dashboard']['id'],
  File "/tmp/grimoirelab-kidash/kidash/kidash.py", line 698, in import_item_json
    if res_content['error']['type'] == "strict_dynamic_mapping_exception" and \
       ~~~~~~~~~~~~~~~~~~~~^^^^^^^^
TypeError: string indices must be integers, not 'str'

Neither:

kidash -g -e https://admin:admin@172.16.46.148:9200 --import /tmp/grimoirelab-sigils/panels/json/opensearch_dashboards/about.ndjson 

2024-10-25 15:53:55,651 Debug mode activated
2024-10-25 15:53:55,651 Reading panels JSON file: /tmp/grimoirelab-sigils/panels/json/opensearch_dashboards/about.ndjson
2024-10-25 15:53:55,651 Reading panel from directory: /tmp/grimoirelab-sigils/panels/json/opensearch_dashboards/about.ndjson
2024-10-25 15:53:55,652 Wrong file format (not JSON): /tmp/grimoirelab-sigils/panels/json/opensearch_dashboards/about.ndjson
2024-10-25 15:53:55,652 Can not find a valid JSON in: /tmp/grimoirelab-sigils/panels/json/opensearch_dashboards/about.ndjson
2024-10-25 15:53:55,652 Can not find a valid JSON in: /tmp/grimoirelab-sigils/panels/json/opensearch_dashboards/about.ndjson

But can be imported by dragging the ndjson file from panels/json/opensearch_dashboards into opensearch-dashboard webUI manually.

zhquan commented 1 day ago

Opss sorry I was not clear if you are using ElasticSearch 6.8.6 + Kibana or Kibiter you have to use kidash to import json files but if you are using OpenSearch Dashboard you can import directly the ndjson files using the WebUI as you said.

Eroyi commented 1 day ago

Opss sorry I was not clear if you are using ElasticSearch 6.8.6 + Kibana or Kibiter you have to use kidash to import json files but if you are using OpenSearch Dashboard you can import directly the ndjson files using the WebUI as you said.

These instructions would be great to have in the tutorial instead of a closed issue.

Also, I'd love to share the helm chart I've composed for Grimorelab. If you're interested, just let me know.