Netflix / conductor

Conductor is a microservices orchestration engine.
Apache License 2.0
12.82k stars 2.34k forks source link

conductor with ES7 worker logs does not show #3427

Open johnsilvan70 opened 1 year ago

johnsilvan70 commented 1 year ago

Describe the bug Conductor deployed using docker compose along with elasticsearch 7 - worker logs doesnt show up in the in the task execution tab.

Details Conductor version: 3.13.2 Persistence implementation: Postgres Queue implementation: Postgres

any executed task does not contain logs in the logs tab for the task and says "no logs found"

below error can be seen on conductor server: {“error”:{“root_cause”:[{“type”:“query_shard_exception”,“reason”:“No mapping found for [createdTime] in order to sort on”,“index_uuid”:“inLgCf8KTU6kfS52rUySKQ”,“index”:“conductor_task_log_20221202"},{“type”:“query_shard_exception”,“reason”:“No mapping found for [createdTime] in order to sort on”,“index_uuid”:“EfMa1gyOQl2R_QvaD4d9Ug”,“index”:“conductor_task_log_20221203"},{“type”:“query_shard_exception”,“reason”:“No mapping found for [createdTime] in order to sort on”,“index_uuid”

manan164 commented 1 year ago

Hi @johnsilvan70 , by default conductor does not populate task logs information for system tasks. However,. there is a way in which worker tasks can pass task logs in the task result object while updating the task and that will be indexed and searchable from UI. If you want more information on this please connect here