search

thoth-station / mi-scheduler

This repository schedules workflows for thoth-station/mi project
GNU General Public License v3.0
0 stars 8 forks source link

Scheduling aggregation jobs failed [incorrect workflow naming - changing dashes to underscores in repository name] #249

Open xtuchyna opened 1 year ago

xtuchyna commented 1 year ago

Description Related to https://github.com/thoth-station/mi/issues/603

While on smaug in thoth-test-core, after launching

$ oc create job --from=cronjob/mi-scheduler-kebechet-analyse mi-kebechet-data

The pod never finishes successfully.

Problem

"Invalid value: \"mi-analysis-aicoe-aiops-maling_list_analysis_toolkit-analysis-thoth-221013185947-906b269d8ad0b919\": a lowercase RFC 1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?(\\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')","field":"metadata.name"}]},"code":422}

It seems that the job in thoth-application incorrectly changes dashes to underscores.

Dependencies

After new common ~release~ https://github.com/thoth-station/common/issues/1292

LOGS

{"name": "thoth.common", "levelname": "WARNING", "module": "logging", "lineno": 340, "funcname": "init_logging", "created": 1665687566.5670152, "asctime": "2022-10-13 18:59:26,567", "msecs": 567.0151710510254, "relative_created": 5290.780067443848, "process": 1, "message": "Logging to a Sentry instance is turned off"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 199, "funcname": "<module>", "created": 1665687566.5675294, "asctime": "2022-10-13 18:59:26,567", "msecs": 567.5294399261475, "relative_created": 5291.29433631897, "process": 1, "message": "mi-scheduler for scheduling mi workflows v1.7.6"}
{"name": "thoth.common.openshift", "levelname": "WARNING", "module": "openshift", "lineno": 162, "funcname": "__init__", "created": 1665687566.5881288, "asctime": "2022-10-13 18:59:26,588", "msecs": 588.1288051605225, "relative_created": 5311.893701553345, "process": 1, "message": "TLS verification when communicating with k8s/okd master is disabled"}
{"name": "thoth.storages.graph.postgres", "levelname": "WARNING", "module": "postgres", "lineno": 392, "funcname": "is_schema_up2date", "created": 1665687566.9806104, "asctime": "2022-10-13 18:59:26,980", "msecs": 980.6103706359863, "relative_created": 5704.375267028809, "process": 1, "message": "The database schema is not in sync with library head revision, the current library revision head: '2b787ddad4a4', database head: '7f7411e247d6'"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687568.8268347, "asctime": "2022-10-13 18:59:28,826", "msecs": 826.8346786499023, "relative_created": 7550.599575042725, "process": 1, "message": "repository thoth-station/result-api is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687569.036757, "asctime": "2022-10-13 18:59:29,036", "msecs": 36.75699234008789, "relative_created": 7760.52188873291, "process": 1, "message": "repository thoth-station/cleanup-job is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687569.6472876, "asctime": "2022-10-13 18:59:29,647", "msecs": 647.2876071929932, "relative_created": 8371.052503585815, "process": 1, "message": "repository thoth-station/dependency-monkey is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687570.4823313, "asctime": "2022-10-13 18:59:30,482", "msecs": 482.3312759399414, "relative_created": 9206.096172332764, "process": 1, "message": "repository thoth-station/graphexp is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687570.5895536, "asctime": "2022-10-13 18:59:30,589", "msecs": 589.5535945892334, "relative_created": 9313.318490982056, "process": 1, "message": "repository thoth-station/goblinoid is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687570.7979403, "asctime": "2022-10-13 18:59:30,797", "msecs": 797.9402542114258, "relative_created": 9521.705150604248, "process": 1, "message": "repository thoth-station/build-analyzers is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687571.3350196, "asctime": "2022-10-13 18:59:31,335", "msecs": 335.019588470459, "relative_created": 10058.784484863281, "process": 1, "message": "repository thoth-station/test-infra is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687571.4440947, "asctime": "2022-10-13 18:59:31,444", "msecs": 444.0946578979492, "relative_created": 10167.859554290771, "process": 1, "message": "repository thoth-station/naming-service is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687571.6852744, "asctime": "2022-10-13 18:59:31,685", "msecs": 685.2743625640869, "relative_created": 10409.03925895691, "process": 1, "message": "repository thoth-station/ansible-role-core-imagestreams is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687571.811922, "asctime": "2022-10-13 18:59:31,811", "msecs": 811.9220733642578, "relative_created": 10535.68696975708, "process": 1, "message": "repository thoth-station/tensorflow-build-s2i is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687571.9152894, "asctime": "2022-10-13 18:59:31,915", "msecs": 915.2894020080566, "relative_created": 10639.054298400879, "process": 1, "message": "repository thoth-station/zuul-config is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687572.021206, "asctime": "2022-10-13 18:59:32,021", "msecs": 21.205902099609375, "relative_created": 10744.970798492432, "process": 1, "message": "repository thoth-station/zuul-jobs is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687572.343137, "asctime": "2022-10-13 18:59:32,343", "msecs": 343.1370258331299, "relative_created": 11066.901922225952, "process": 1, "message": "repository thoth-station/prometheus-pushgateway is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687572.4483569, "asctime": "2022-10-13 18:59:32,448", "msecs": 448.35686683654785, "relative_created": 11172.12176322937, "process": 1, "message": "repository thoth-station/observations is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687572.9507232, "asctime": "2022-10-13 18:59:32,950", "msecs": 950.7231712341309, "relative_created": 11674.488067626953, "process": 1, "message": "repository thoth-station/tensorflow-release-job is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687573.1830492, "asctime": "2022-10-13 18:59:33,183", "msecs": 183.04920196533203, "relative_created": 11906.814098358154, "process": 1, "message": "repository thoth-station/tensorflow-release-api is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687573.2933142, "asctime": "2022-10-13 18:59:33,293", "msecs": 293.31421852111816, "relative_created": 12017.07911491394, "process": 1, "message": "repository thoth-station/nefertem is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687573.8955512, "asctime": "2022-10-13 18:59:33,895", "msecs": 895.5512046813965, "relative_created": 12619.316101074219, "process": 1, "message": "repository thoth-station/external-janusgraph-service is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687573.9875143, "asctime": "2022-10-13 18:59:33,987", "msecs": 987.5142574310303, "relative_created": 12711.279153823853, "process": 1, "message": "repository thoth-station/ansible-role-core-templates is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687574.0984163, "asctime": "2022-10-13 18:59:34,098", "msecs": 98.41632843017578, "relative_created": 12822.181224822998, "process": 1, "message": "repository thoth-station/sentry-openshift is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687574.2165852, "asctime": "2022-10-13 18:59:34,216", "msecs": 216.5851593017578, "relative_created": 12940.35005569458, "process": 1, "message": "repository thoth-station/ansible-role-configmaps-and-secrets is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687574.4822016, "asctime": "2022-10-13 18:59:34,482", "msecs": 482.20157623291016, "relative_created": 13205.966472625732, "process": 1, "message": "repository thoth-station/ansible-role-cronjob is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687574.8130622, "asctime": "2022-10-13 18:59:34,813", "msecs": 813.0621910095215, "relative_created": 13536.827087402344, "process": 1, "message": "repository thoth-station/ansible-role-metrics-exporter is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687574.9215348, "asctime": "2022-10-13 18:59:34,921", "msecs": 921.5347766876221, "relative_created": 13645.299673080444, "process": 1, "message": "repository thoth-station/ansible-role-amun is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687575.1533332, "asctime": "2022-10-13 18:59:35,153", "msecs": 153.33318710327148, "relative_created": 13877.098083496094, "process": 1, "message": "repository thoth-station/website is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687575.2653263, "asctime": "2022-10-13 18:59:35,265", "msecs": 265.32626152038574, "relative_created": 13989.091157913208, "process": 1, "message": "repository thoth-station/selinon-worker is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687575.3830671, "asctime": "2022-10-13 18:59:35,383", "msecs": 383.06713104248047, "relative_created": 14106.832027435303, "process": 1, "message": "repository thoth-station/selinon-api is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687575.4855466, "asctime": "2022-10-13 18:59:35,485", "msecs": 485.5465888977051, "relative_created": 14209.311485290527, "process": 1, "message": "repository thoth-station/osiris is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687575.5928988, "asctime": "2022-10-13 18:59:35,592", "msecs": 592.8988456726074, "relative_created": 14316.66374206543, "process": 1, "message": "repository thoth-station/janusgraph-thoth-config is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687575.977037, "asctime": "2022-10-13 18:59:35,977", "msecs": 977.0369529724121, "relative_created": 14700.801849365234, "process": 1, "message": "repository thoth-station/package-build-controller is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687576.078031, "asctime": "2022-10-13 18:59:36,078", "msecs": 78.03106307983398, "relative_created": 14801.795959472656, "process": 1, "message": "repository thoth-station/tensorflow-serving-build is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687576.1881692, "asctime": "2022-10-13 18:59:36,188", "msecs": 188.1692409515381, "relative_created": 14911.93413734436, "process": 1, "message": "repository thoth-station/graph-sync-scheduler is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687576.5450888, "asctime": "2022-10-13 18:59:36,545", "msecs": 545.0887680053711, "relative_created": 15268.853664398193, "process": 1, "message": "repository thoth-station/osiris-build-observer is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687576.6574414, "asctime": "2022-10-13 18:59:36,657", "msecs": 657.4413776397705, "relative_created": 15381.206274032593, "process": 1, "message": "repository thoth-station/workload-operator is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687577.2097147, "asctime": "2022-10-13 18:59:37,209", "msecs": 209.7146511077881, "relative_created": 15933.47954750061, "process": 1, "message": "repository thoth-station/package-analyzer is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687577.814072, "asctime": "2022-10-13 18:59:37,814", "msecs": 814.0718936920166, "relative_created": 16537.83679008484, "process": 1, "message": "repository thoth-station/stub-api is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687577.9175324, "asctime": "2022-10-13 18:59:37,917", "msecs": 917.5324440002441, "relative_created": 16641.297340393066, "process": 1, "message": "repository thoth-station/dgraph-thoth-config is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687578.021958, "asctime": "2022-10-13 18:59:38,021", "msecs": 21.958112716674805, "relative_created": 16745.723009109497, "process": 1, "message": "repository thoth-station/nvidia-usage-dashboard is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687578.1473937, "asctime": "2022-10-13 18:59:38,147", "msecs": 147.39370346069336, "relative_created": 16871.158599853516, "process": 1, "message": "repository thoth-station/kebechet-website-tooling is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687578.29768, "asctime": "2022-10-13 18:59:38,297", "msecs": 297.6799011230469, "relative_created": 17021.44479751587, "process": 1, "message": "repository thoth-station/rapidsai-build is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687578.5232005, "asctime": "2022-10-13 18:59:38,523", "msecs": 523.200511932373, "relative_created": 17246.965408325195, "process": 1, "message": "repository thoth-station/dgraph-operator is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687578.6300187, "asctime": "2022-10-13 18:59:38,630", "msecs": 630.0187110900879, "relative_created": 17353.78360748291, "process": 1, "message": "repository thoth-station/s2i-example-flask is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687578.8589132, "asctime": "2022-10-13 18:59:38,858", "msecs": 858.9131832122803, "relative_created": 17582.678079605103, "process": 1, "message": "repository thoth-station/microbenchmarks is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687579.3400593, "asctime": "2022-10-13 18:59:39,340", "msecs": 340.0592803955078, "relative_created": 18063.82417678833, "process": 1, "message": "repository thoth-station/ansible-role-argo-workflows is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687579.4382386, "asctime": "2022-10-13 18:59:39,438", "msecs": 438.23862075805664, "relative_created": 18162.00351715088, "process": 1, "message": "repository thoth-station/workflows is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687579.5335608, "asctime": "2022-10-13 18:59:39,533", "msecs": 533.5607528686523, "relative_created": 18257.325649261475, "process": 1, "message": "repository thoth-station/graph-cache-refresh-job is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687579.6342337, "asctime": "2022-10-13 18:59:39,634", "msecs": 634.2337131500244, "relative_created": 18357.998609542847, "process": 1, "message": "repository thoth-station/postgresql-thoth-config is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687579.7448833, "asctime": "2022-10-13 18:59:39,744", "msecs": 744.8832988739014, "relative_created": 18468.648195266724, "process": 1, "message": "repository thoth-station/ansible-role-postgresql is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687579.8489666, "asctime": "2022-10-13 18:59:39,848", "msecs": 848.9665985107422, "relative_created": 18572.731494903564, "process": 1, "message": "repository thoth-station/ansible-role-kebechet is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687580.391634, "asctime": "2022-10-13 18:59:40,391", "msecs": 391.6339874267578, "relative_created": 19115.39888381958, "process": 1, "message": "repository thoth-station/ansible-role-postgresql-metrics-exporter is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687580.6605701, "asctime": "2022-10-13 18:59:40,660", "msecs": 660.5701446533203, "relative_created": 19384.335041046143, "process": 1, "message": "repository thoth-station/qeb-hwt is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687581.0797222, "asctime": "2022-10-13 18:59:41,079", "msecs": 79.72216606140137, "relative_created": 19803.487062454224, "process": 1, "message": "repository thoth-station/pipenv is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687581.2207334, "asctime": "2022-10-13 18:59:41,220", "msecs": 220.7334041595459, "relative_created": 19944.498300552368, "process": 1, "message": "repository thoth-station/ash-api is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687582.1523774, "asctime": "2022-10-13 18:59:42,152", "msecs": 152.37736701965332, "relative_created": 20876.142263412476, "process": 1, "message": "repository thoth-station/pipelines-catalog is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687582.700061, "asctime": "2022-10-13 18:59:42,700", "msecs": 700.0610828399658, "relative_created": 21423.825979232788, "process": 1, "message": "repository thoth-station/workflow-controller is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687582.813889, "asctime": "2022-10-13 18:59:42,813", "msecs": 813.8890266418457, "relative_created": 21537.653923034668, "process": 1, "message": "repository thoth-station/jupyter-notebooks is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687583.560269, "asctime": "2022-10-13 18:59:43,560", "msecs": 560.2691173553467, "relative_created": 22284.03401374817, "process": 1, "message": "repository thoth-station/bz1816214-example is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687585.5624213, "asctime": "2022-10-13 18:59:45,562", "msecs": 562.4213218688965, "relative_created": 24286.18621826172, "process": 1, "message": "repository thoth-station/solver-errors-reporter is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687586.240928, "asctime": "2022-10-13 18:59:46,240", "msecs": 240.92793464660645, "relative_created": 24964.69283103943, "process": 1, "message": "repository thoth-station/report-visualization is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 99, "funcname": "_initialize_repositories_from_raw", "created": 1665687586.5506153, "asctime": "2022-10-13 18:59:46,550", "msecs": 550.6153106689453, "relative_created": 25274.380207061768, "process": 1, "message": "repository thoth-station/image-pusher is archived, therefore skipped"}
{"name": "thoth.mi-scheduler", "levelname": "INFO", "module": "app", "lineno": 128, "funcname": "schedule_for_kebechet_analysis", "created": 1665687587.265558, "asctime": "2022-10-13 18:59:47,265", "msecs": 265.55800437927246, "relative_created": 25989.322900772095, "process": 1, "message": "Scheduled mi-kebechet analysis with id 'mi-analysis-thoth-station-s2i-scipy-notebook-analysis-thoth-221013185947-a5f5ca903b0b4bb4'"}
Traceback (most recent call last):
  File "app.py", line 200, in <module>
    main(auto_envvar_prefix="SCHEDULE")
  File "/opt/app-root/lib64/python3.8/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/opt/app-root/lib64/python3.8/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/opt/app-root/lib64/python3.8/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/app-root/lib64/python3.8/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "app.py", line 192, in main
    Schedule(github=gh, openshift=oc, repositories=kebechet_repos, subdir=subdir).schedule_for_kebechet_analysis()
  File "app.py", line 121, in schedule_for_kebechet_analysis
    workflow_id = self.oc.schedule_mi_workflow(
  File "/opt/app-root/lib64/python3.8/site-packages/thoth/common/openshift.py", line 1517, in schedule_mi_workflow
    return self._schedule_workflow(
  File "/opt/app-root/lib64/python3.8/site-packages/thoth/common/openshift.py", line 1114, in _schedule_workflow
    return workflow(**parameters)
  File "/opt/app-root/lib64/python3.8/site-packages/thoth/common/workflows.py", line 829, in submit_mi
    workflow_id: Optional[str] = self.submit_workflow_from_template(
  File "/opt/app-root/lib64/python3.8/site-packages/thoth/common/workflows.py", line 504, in submit_workflow_from_template
    workflow_id = self.submit_workflow(
  File "/opt/app-root/lib64/python3.8/site-packages/thoth/common/workflows.py", line 460, in submit_workflow
    created: models.V1alpha1Workflow = self.api.create_namespaced_workflow(  # noqa
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/api/v1alpha1_api.py", line 309, in create_namespaced_workflow
    return self.create_namespaced_workflow_with_http_info(namespace, body, **kwargs)  # noqa: E501
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/api/v1alpha1_api.py", line 392, in create_namespaced_workflow_with_http_info
    return self.api_client.call_api(
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/api_client.py", line 364, in call_api
    return self.__call_api(resource_path, method,
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/api_client.py", line 188, in __call_api
    raise e
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/api_client.py", line 181, in __call_api
    response_data = self.request(
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/api_client.py", line 407, in request
    return self.rest_client.POST(url,
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/rest.py", line 265, in POST
    return self.request("POST", url,
  File "/opt/app-root/lib64/python3.8/site-packages/argo/workflows/client/rest.py", line 224, in request
    raise ApiException(http_resp=r)
argo.workflows.client.exceptions.ApiException: (422)
Reason: Unprocessable Entity
HTTP response headers: HTTPHeaderDict({'Audit-Id': '69a945b3-4a93-41ef-8376-fd98ef191865', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '59b5659f-a297-44da-8b14-ce23ddcd57c5', 'X-Kubernetes-Pf-Prioritylevel-Uid': '7e6bfd5c-9de3-41f9-8925-7dd28871b5fc', 'Date': 'Thu, 13 Oct 2022 18:59:47 GMT', 'Content-Length': '1268'})
HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Workflow.argoproj.io \"mi-analysis-aicoe-aiops-maling_list_analysis_toolkit-analysis-thoth-221013185947-906b269d8ad0b919\" is invalid: metadata.name: Invalid value: \"mi-analysis-aicoe-aiops-maling_list_analysis_toolkit-analysis-thoth-221013185947-906b269d8ad0b919\": a lowercase RFC 1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?(\\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')","reason":"Invalid","details":{"name":"mi-analysis-aicoe-aiops-maling_list_analysis_toolkit-analysis-thoth-221013185947-906b269d8ad0b919","group":"argoproj.io","kind":"Workflow","causes":[{"reason":"FieldValueInvalid","message":"Invalid value: \"mi-analysis-aicoe-aiops-maling_list_analysis_toolkit-analysis-thoth-221013185947-906b269d8ad0b919\": a lowercase RFC 1123 subdomain must consist of lower case alphanumeric characters, '-' or '.', and must start and end with an alphanumeric character (e.g. 'example.com', regex used for validation is '[a-z0-9]([-a-z0-9]*[a-z0-9])?(\\.[a-z0-9]([-a-z0-9]*[a-z0-9])?)*')","field":"metadata.name"}]},"code":422}
xtuchyna commented 1 year ago

mi-scheduler is given two names that contain underscore character (that is not supported in workflow name):

{"name": "thoth.mi-scheduler", "levelname": "DEBUG", "module": "app", "lineno": 192, "funcname": "main", "created": 1666790602.3634036, "asctime": "2022-10-26 13:23:22,363", "msecs": 363.4035587310791, "relative_created": 7109.996318817139, "process": 1, "message": "Got these active kebechet installation repos: ['aicoe-aiops/ocp-alert-prediction-public', 'opendatahub-io/jupyterhub-odh', 'opendatahub-io/jupyterhub-singleuser-profiles', 'opendatahub-io/jupyterhub-quickstart', 'aicoe-aiops/maling_list_analysis_toolkit', 'thoth-station/package-extract', 'thoth-station/core', 'thoth-station/result-api', 'thoth-station/user-api', 'thoth-station/cleanup-job', 'thoth-station/solver', 'thoth-station/thoth', 'thoth-station/storages', 'thoth-station/graph-sync-job', 'thoth-station/dependency-monkey', 'thoth-station/common', 'thoth-station/analyzer', 'thoth-station/lab', 'thoth-station/jupyter-notebook', 'thoth-station/notebooks', 'thoth-station/adviser', 'thoth-station/graphexp', 'thoth-station/goblinoid', 'thoth-station/thoth-station.github.io', 'thoth-station/build-analyzers', 'thoth-station/misc', 'thoth-station/package-releases-job', 'thoth-station/graph-refresh-job', 'thoth-station/test-infra', 'thoth-station/naming-service', 'thoth-station/kebechet', 'thoth-station/ansible-role-core-imagestreams', 'thoth-station/tensorflow-build-s2i', 'thoth-station/zuul-config', 'thoth-station/zuul-jobs', 'thoth-station/nepthys', 'thoth-station/srcops-testing', 'thoth-station/prometheus-pushgateway', 'thoth-station/observations', 'thoth-station/httpd-aicoe-container', 'thoth-station/cve-update-job', 'thoth-station/thoth-ops-infra', 'thoth-station/tensorflow-release-job', 'thoth-station/talks', 'thoth-station/tensorflow-release-api', 'thoth-station/nefertem', 'thoth-station/thamos', 'thoth-station/amun-api', 'thoth-station/amun-client', 'thoth-station/thoth-ops', 'thoth-station/external-janusgraph-service', 'thoth-station/ansible-role-core-templates', 'thoth-station/sentry-openshift', 'thoth-station/ansible-role-configmaps-and-secrets', 'thoth-station/amun-hwinfo', 'thoth-station/ansible-role-cronjob', 'thoth-station/openblas', 'thoth-station/metrics-exporter', 'thoth-station/ansible-role-metrics-exporter', 'thoth-station/ansible-role-amun', 'thoth-station/management-api', 'thoth-station/website', 'thoth-station/selinon-worker', 'thoth-station/selinon-api', 'thoth-station/osiris', 'thoth-station/janusgraph-thoth-config', 'thoth-station/python', 'thoth-station/tensorflow', 'thoth-station/package-build-controller', 'thoth-station/tensorflow-serving-build', 'thoth-station/graph-sync-scheduler', 'thoth-station/init-job', 'thoth-station/isis-api', 'thoth-station/osiris-build-observer', 'thoth-station/workload-operator', 'thoth-station/contra-env-infra', 'thoth-station/performance', 'thoth-station/build-watcher', 'thoth-station/package-analyzer', 'thoth-station/statusfy', 'thoth-station/statusfy-ops', 'thoth-station/website-tooling', 'thoth-station/cuda', 'thoth-station/stub-api', 'thoth-station/dgraph-thoth-config', 'thoth-station/nvidia-usage-dashboard', 'thoth-station/kebechet-website-tooling', 'thoth-station/rapidsai-build', 'thoth-station/invectio', 'thoth-station/dgraph-operator', 'thoth-station/s2i-example-flask', 'thoth-station/integration-tests', 'thoth-station/microbenchmarks', 'thoth-station/jupyter-nbrequirements', 'thoth-station/s2i-example', 'thoth-station/s2i-thoth', 'thoth-station/ansible-role-argo-workflows', 'thoth-station/workflows', 'thoth-station/graph-cache-refresh-job', 'thoth-station/postgresql-thoth-config', 'thoth-station/ansible-role-postgresql', 'thoth-station/ansible-role-kebechet', 'thoth-station/template-project', 'thoth-station/messaging', 'thoth-station/mi', 'thoth-station/ansible-role-postgresql-metrics-exporter', 'thoth-station/thoth-pybench', 'thoth-station/qeb-hwt', 'thoth-station/graph-backup-job', 'thoth-station/jupyter-notebook-s2i', 'thoth-station/pipenv', 'thoth-station/ash-api', 'thoth-station/package-update-job', 'thoth-station/s2i', 'thoth-station/micropipenv', 'thoth-station/solver-error-classfier', 'thoth-station/thoth-application', 'thoth-station/source-management', 'thoth-station/pipelines-catalog', 'thoth-station/fext', 'thoth-station/advise-reporter', 'thoth-station/workflow-controller', 'thoth-station/jupyter-notebooks', 'thoth-station/s2i-minimal-notebook', 'thoth-station/s2i-tensorflow-notebook', 'thoth-station/s2i-scipy-notebook', 'thoth-station/investigator', 'thoth-station/cli-examples', 'thoth-station/bz1816214-example', 'thoth-station/slo-reporter', 'thoth-station/revsolver', 'thoth-station/buildlog-parser', 'thoth-station/s2i-example-migration', 'thoth-station/thoth-toolbox', 'thoth-station/datasets', 'thoth-station/jupyternb-build-pipeline', 'thoth-station/si-bandit', 'thoth-station/si-cloc', 'thoth-station/si-aggregator', 'thoth-station/workflow-helpers', 'thoth-station/s2i-python-container', 'thoth-station/solver-errors-reporter', 'thoth-station/mi-scheduler', 'thoth-station/glyph', 'thoth-station/report-processing', 'thoth-station/report-visualization', 'thoth-station/sync-job', 'thoth-station/image-pusher', 'thoth-station/dependency-monkey-zoo', 'aicoe-aiops/fedora-mailing-list-analysis', 'aicoe-aiops/categorical-encoding-public', 'AICoE/aicoe-ci', 'KPostOffice/khebhut_test']"}

that is KPostOffice/khebhut_test and the mentioned aicoe-aiops/maling_list_analysis_toolkit

Gkrumbach07 commented 1 year ago

pending verification for closure /kind bug