chaoss / grimoirelab

GrimoireLab: platform for software development analytics and insights
https://chaoss.github.io/grimoirelab/
GNU General Public License v3.0
486 stars 181 forks source link

How can I fix the error in sirmordred docker logs? #643

Open pilgrimage80 opened 6 months ago

pilgrimage80 commented 6 months ago

This error prevents the data from coming to the web interface when I run grimoerilab. It causes a no result found error.

2024-03-22 10:39:11,322 - GrimoireLab - sirmordred.task_collection - INFO - [gitlab:issues] collection phase starts 2024-03-22 10:39:11,323 - GrimoireLab - sirmordred.task_manager - ERROR - [gitlab:issues] Exception in Task Manager list index out of range Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/sirmordred/task_manager.py", line 98, in run task.execute() File "/usr/local/lib/python3.8/site-packages/sirmordred/task_collection.py", line 116, in execute backend_args = self._compose_perceval_params(self.backend_section, repo) File "/usr/local/lib/python3.8/site-packages/sirmordred/task.py", line 145, in _compose_perceval_params params = ocean.get_perceval_params_from_url(repo) File "/usr/local/lib/python3.8/site-packages/grimoire_elk/raw/gitlab.py", line 98, in get_perceval_params_from_url owner = repo.split('/')[-2] IndexError: list index out of range 2024-03-22 10:39:11,371 - GrimoireLab - sirmordred.task_collection - INFO - [gitlab:merge] collection phase starts 2024-03-22 10:39:11,372 - GrimoireLab - sirmordred.task_manager - ERROR - [gitlab:merge] Exception in Task Manager list index out of range Traceback (most recent call last): File "/usr/local/lib/python3.8/site-packages/sirmordred/task_manager.py", line 98, in run task.execute() File "/usr/local/lib/python3.8/site-packages/sirmordred/task_collection.py", line 116, in execute backend_args = self._compose_perceval_params(self.backend_section, repo) File "/usr/local/lib/python3.8/site-packages/sirmordred/task.py", line 145, in _compose_perceval_params params = ocean.get_perceval_params_from_url(repo) File "/usr/local/lib/python3.8/site-packages/grimoire_elk/raw/gitlab.py", line 98, in get_perceval_params_from_url owner = repo.split('/')[-2] IndexError: list index out of range

GrimoireLab - sirmordred.task_manager - ERROR - [gitlab:issues] Exception in Task Manager list index out of range Traceback (most recent call last):

pilgrimage80 commented 6 months ago

Project.json

{ "Yonca": { "git": "https://gitlabtest/tutel/yonca.git", "gitlab:issues": "https://gitlabtest/tutel/yonca/issues", "gitlab:merge": "https://gitlabtest/tutel/yonca/merge_requests" } }

SETUP.cfg

[general] short_name = GrimoireLab update = true min_update_delay = 60 debug = false logs_dir = /home/grimoire/logs bulk_size = 100 scroll_size = 100 aliases_file = /home/grimoire/aliases.json

[projects] projects_file = /home/grimoire/conf/projects.json

[es_collection] url = http://elasticsearch:9200

[es_enrichment] url = http://elasticsearch:9200 autorefresh = true

[sortinghat] host = nginx user = root password = root port = 8000 path = /identities/api/ ssl = false database = sortinghat_db autoprofile = [github, git] matching = [email,name,username] sleep_for = 100 unaffiliated_group = Unknown affiliate = true

[panels] kibiter_time_from = now-90d kibiter_default_index = git kibiter_url = http://kibiter:5601 kibiter_version = 6.8.6-3 gitlab-issues = true

[phases] collection = true identities = true enrichment = true panels = true

[bugzillarest]

raw_index = bugzillarest_demo_raw

enriched_index = bugzillarest_demo_enriched

no-archive = true

[confluence]

no-archive = true

raw_index = confluence_demo_raw

enriched_index = confluence_demo_enriched

[discourse]

raw_index = discourse_demo_raw

enriched_index = discourse_demo_enriched

no-archive = true

[git]

raw_index = git_demo_raw

enriched_index = git_demo_enriched

latest-items = true

studies = [enrich_demography:git, enrich_areas_of_code:git, enrich_onion:git]

[github]

api-token =

enterprise-url =

raw_index = github_demo_raw

sleep-for-rate = true

sleep-time = "300"

enriched_index = github_demo_enriched

[gitlab:issues] api-token = H4iQWJ_9sB7LG9RndKHL raw_index = gitlab_issues_demo_raw enriched_index = gitlab_issues_demo_enriched no-archive = true enterprise-url = https://gitlabtest sleep-for-rate = true

[gitlab:issue]

category = issue

raw_index = gitlab-issues_raw

enriched_index = gitlab-issues_enriched

api-token = H4iQWJ_9sB7LG9RndKHL

sleep-for-rate = true

no-archive = true (suggested)

studies = [enrich_onion:gitlab-issue] (optional)

[gitlab:merge] api-token = H4iQWJ_9sB7LG9RndKHL raw_index = gitlab_merges_demo_raw enriched_index = gitlab_merges_demo_enriched no-archive = true enterprise-url = https://gitlabtest category = merge_request sleep-for-rate = true

[jira]

raw_index = jira_demo_raw

enriched_index = jira_demo_enriched

no-archive = true

[pipermail]

raw_index = pipermail_demo_raw

enriched_index = pipermail_demo_enriched

no-verify = true

[mediawiki]

raw_index = mediawiki_demo_raw

enriched_index = mediawiki_demo_enriched

no-archive = true

[meetup]

raw_index = meetup_demo_raw

enriched_index = meetup_demo_enriched

api-token =

no-archive = true

sleep-for-rate = true

sleep-time = "300"

[stackexchange]

raw_index = stackexchange_demo_raw

enriched_index = stackexchange_demo_enriched

api-token =

no-archive = true

[slack]

raw_index = slack_demo_raw

enriched_index = slack_demo_enriched

api-token =

no-archive = true

[supybot]

raw_index = supybot_demo_raw

enriched_index = supybot_demo_enriched

[twitter]

raw_index = twitter_demo_raw

enriched_index = twitter_demo_enriched

api-token =

no-archive = true

sleep-for-rate = true

sleep-time = 300

studies based on enriched indexes

[enrich_demography:git]

[enrich_areas_of_code:git]

in_index = git_demo_raw

out_index = git-aoc_demo_enriched

[enrich_onion:git]

in_index = git

out_index = git-onion_demo_enriched

contribs_field = hash

[enrich_onion:gitlab-issue] # (optional) in_index = gitlab-issues_enriched out_index = gitlab-issues-onion_enriched data_source = gitlab-issues

sduenas commented 6 months ago

What's your project.json file? It seems you are not using the right urls for gitlab repos.

pilgrimage80 commented 6 months ago

Project.json

{ "Yonca": { "git": "https://gitlabtest/tutel/yonca.git", "gitlab:issues": "https://gitlabtest/tutel/yonca/issues", "gitlab:merge": "https://gitlabtest/tutel/yonca/merge_requests" } }

zhquan commented 6 months ago

Hi @pilgrimage80

The projects.json is wrong, you don't need to add issues or merge_requests. More info at https://github.com/chaoss/grimoirelab-sirmordred?tab=readme-ov-file#gitlab-

Try again using this one:

{
    "Yonca": {
        "git": [
            "https://gitlabtest/tutel/yonca.git"
        ],
        "gitlab:issues": [
            "https://gitlabtest/tutel/yonca"
        ],
        "gitlab:merge": [
            "https://gitlabtest/tutel/yonca"
        ]
    }
}