search

syndesisio / syndesis

This project is archived. A flexible, customizable, open source platform that provides core integration capabilities as a service.
https://syndesis.io/
Apache License 2.0
597 stars 204 forks source link

kafka Integration problem #9628

Closed suoxun closed 3 years ago

suoxun commented 3 years ago

When I create Kafka integration again, the generated project integration starts to report an error. The JSON of the project is:

{
    "connections": {
        ":i-MbFUiwa55rqfTUoRIMsz": {
            "configuredProperties": {
                "brokers": "10.8.183.126:9092,10.8.183.127:9092,10.8.183.128:9092",
                "extraOptions": "[]",
                "transportProtocol": "PLAINTEXT"
            },
            "connector": {
                "actions": [{
                    "actionType": "connector",
                    "description": "Publish data to the Kafka topic that you select.",
                    "descriptor": {
                        "inputDataShape": {
                            "kind": "any"
                        },
                        "outputDataShape": {
                            "kind": "none"
                        },
                        "propertyDefinitionSteps": [{
                            "description": "Specify Kafka topic name",
                            "name": "Select the Kafka topic",
                            "properties": {
                                "topic": {
                                    "componentProperty": false,
                                    "deprecated": false,
                                    "displayName": "Topic Name",
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "path",
                                    "labelHint": "Select the Kafka topic to send data to.",
                                    "order": 1,
                                    "required": true,
                                    "secret": false,
                                    "type": "dataList"
                                }
                            }
                        }]
                    },
                    "id": "io.syndesis:kafka-publish-action",
                    "name": "Publish",
                    "pattern": "To",
                    "tags": ["dynamic"]
                }, {
                    "actionType": "connector",
                    "description": "Receive data from the Kafka topic that you select.",
                    "descriptor": {
                        "inputDataShape": {
                            "kind": "none"
                        },
                        "outputDataShape": {
                            "kind": "any"
                        },
                        "propertyDefinitionSteps": [{
                            "description": "Select the Kafka topic name",
                            "name": "Select the Kafka topic",
                            "properties": {
                                "topic": {
                                    "componentProperty": false,
                                    "deprecated": false,
                                    "displayName": "Topic Name",
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "path",
                                    "labelHint": "Select the Kafka topic to receive data from.",
                                    "order": 1,
                                    "required": true,
                                    "secret": false,
                                    "type": "dataList"
                                }
                            }
                        }]
                    },
                    "id": "io.syndesis:kafka-subscribe-action",
                    "name": "Subscribe",
                    "pattern": "From",
                    "tags": ["dynamic"]
                }],
                "componentScheme": "kafka",
                "connectorCustomizers": ["io.syndesis.connector.kafka.KafkaConnectionCustomizer"],
                "dependencies": [{
                    "id": "io.syndesis.connector:connector-kafka:2.0-SNAPSHOT",
                    "type": "MAVEN"
                }],
                "description": "Subscribe for and publish messages",
                "icon": "assets:kafka.svg",
                "id": "kafka",
                "name": "Kafka Message Broker",
                "properties": {
                    "brokerCertificate": {
                        "componentProperty": true,
                        "deprecated": false,
                        "displayName": "Broker certificate",
                        "group": "common,security",
                        "javaType": "java.lang.String",
                        "kind": "property",
                        "label": "security",
                        "labelHint": "TLS broker certificate",
                        "order": 3,
                        "required": false,
                        "secret": false,
                        "type": "textarea"
                    },
                    "brokers": {
                        "componentProperty": true,
                        "deprecated": false,
                        "displayName": "Kafka Broker URIs",
                        "group": "common",
                        "javaType": "java.lang.String",
                        "kind": "property",
                        "label": "common",
                        "labelHint": "Comma separated list of Kafka broker URIs in the form host:port",
                        "order": 1,
                        "required": true,
                        "secret": false,
                        "type": "typeahead"
                    },
                    "extraOptions": {
                        "arrayDefinition": {
                            "key": {
                                "displayName": "Key",
                                "type": "text"
                            },
                            "value": {
                                "displayName": "Value",
                                "type": "text"
                            }
                        },
                        "arrayDefinitionOptions": {
                            "i18nAddElementText": "Add",
                            "minElements": 0
                        },
                        "componentProperty": true,
                        "deprecated": false,
                        "displayName": "Extra Options",
                        "group": "common",
                        "javaType": "java.util.List",
                        "kind": "property",
                        "label": "common",
                        "labelHint": "Extra Options for the Kafka connection.",
                        "order": 4,
                        "type": "array"
                    },
                    "transportProtocol": {
                        "componentProperty": true,
                        "defaultValue": "PLAINTEXT",
                        "deprecated": false,
                        "displayName": "Transport Protocol",
                        "enum": [{
                            "label": "PLAIN",
                            "value": "PLAINTEXT"
                        }, {
                            "label": "TLS",
                            "value": "SSL"
                        }],
                        "group": "common,security",
                        "javaType": "java.lang.String",
                        "kind": "property",
                        "label": "security",
                        "labelHint": "The transport protocol. Select TLS for encryption in transit.",
                        "order": 2,
                        "required": true,
                        "secret": false,
                        "type": "string"
                    }
                },
                "tags": ["dynamic", "verifier"],
                "version": 14
            },
            "connectorId": "kafka",
            "createdDate": 1622700650276,
            "description": "Subscribe for and publish messages",
            "icon": "assets:kafka.svg",
            "id": "i-MbFUiwa55rqfTUoRIMsz",
            "isDerived": false,
            "lastUpdated": 1622700650276,
            "name": "测试环境的kafka",
            "userId": "someone_important",
            "uses": 0
        },
        ":i-MbLhX8zbX9wCwP3FX4nz": {
            "configuredProperties": {
                "baseUrl": "https://api-test-internal.gaojihealth.cn/store/api/public/test/kafka"
            },
            "connector": {
                "actions": [{
                    "actionType": "connector",
                    "description": "Invoke an http endpoint URL",
                    "descriptor": {
                        "connectorFactory": "io.syndesis.connector.http.HttpConnectorFactories$Https",
                        "inputDataShape": {
                            "kind": "any"
                        },
                        "outputDataShape": {
                            "kind": "any"
                        },
                        "propertyDefinitionSteps": [{
                            "description": "properties",
                            "name": "properties",
                            "properties": {
                                "httpMethod": {
                                    "defaultValue": "GET",
                                    "deprecated": false,
                                    "displayName": "Http Method",
                                    "enum": [{
                                        "label": "GET",
                                        "value": "GET"
                                    }, {
                                        "label": "PUT",
                                        "value": "PUT"
                                    }, {
                                        "label": "POST",
                                        "value": "POST"
                                    }, {
                                        "label": "DELETE",
                                        "value": "DELETE"
                                    }, {
                                        "label": "HEAD",
                                        "value": "HEAD"
                                    }, {
                                        "label": "OPTIONS",
                                        "value": "OPTIONS"
                                    }, {
                                        "label": "TRACE",
                                        "value": "TRACE"
                                    }, {
                                        "label": "PATCH",
                                        "value": "PATCH"
                                    }],
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "parameter",
                                    "labelHint": "The specific http method to execute.",
                                    "required": false,
                                    "secret": false,
                                    "type": "string"
                                },
                                "path": {
                                    "deprecated": false,
                                    "displayName": "URL Path",
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "parameter",
                                    "labelHint": "Endpoint Path (eg '/path/to/endpoint')",
                                    "required": false,
                                    "secret": false,
                                    "type": "string"
                                }
                            }
                        }]
                    },
                    "id": "io.syndesis.connector:connector-http:https-invoke-url",
                    "name": "Invoke URL",
                    "pattern": "To"
                }, {
                    "actionType": "connector",
                    "description": "Periodically invoke an http endpoint URL",
                    "descriptor": {
                        "connectorCustomizers": ["io.syndesis.connector.http.HttpConnectorCustomizer"],
                        "connectorFactory": "io.syndesis.connector.http.HttpConnectorFactories$Https",
                        "inputDataShape": {
                            "kind": "none"
                        },
                        "outputDataShape": {
                            "kind": "any"
                        },
                        "propertyDefinitionSteps": [{
                            "description": "properties",
                            "name": "properties",
                            "properties": {
                                "httpMethod": {
                                    "defaultValue": "GET",
                                    "deprecated": false,
                                    "displayName": "Http Method",
                                    "enum": [{
                                        "label": "GET",
                                        "value": "GET"
                                    }, {
                                        "label": "PUT",
                                        "value": "PUT"
                                    }, {
                                        "label": "POST",
                                        "value": "POST"
                                    }, {
                                        "label": "DELETE",
                                        "value": "DELETE"
                                    }, {
                                        "label": "HEAD",
                                        "value": "HEAD"
                                    }, {
                                        "label": "OPTIONS",
                                        "value": "OPTIONS"
                                    }, {
                                        "label": "TRACE",
                                        "value": "TRACE"
                                    }, {
                                        "label": "PATCH",
                                        "value": "PATCH"
                                    }],
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "parameter",
                                    "labelHint": "The specific http method to execute.",
                                    "required": false,
                                    "secret": false,
                                    "type": "string"
                                },
                                "path": {
                                    "deprecated": false,
                                    "displayName": "URL Path",
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "parameter",
                                    "labelHint": "Endpoint Path",
                                    "placeholder": "eg '/path/to/endpoint'",
                                    "required": false,
                                    "secret": false,
                                    "type": "string"
                                },
                                "schedulerExpression": {
                                    "defaultValue": 1800000,
                                    "deprecated": false,
                                    "displayName": "Period",
                                    "group": "consumer",
                                    "javaType": "long",
                                    "kind": "parameter",
                                    "labelHint": "Delay between scheduling (executing).",
                                    "required": false,
                                    "secret": false,
                                    "type": "duration"
                                }
                            }
                        }]
                    },
                    "id": "io.syndesis.connector:connector-http:https-periodic-invoke-url",
                    "name": "Periodic invoke URL",
                    "pattern": "From"
                }],
                "componentScheme": "https",
                "configuredProperties": {
                    "headerFilterStrategy": "syndesisHeaderStrategy"
                },
                "dependencies": [{
                    "id": "io.syndesis.connector:connector-http:2.0-SNAPSHOT",
                    "type": "MAVEN"
                }],
                "description": "Invoke various HTTPS methods.",
                "icon": "assets:https.svg",
                "id": "https",
                "name": "HTTPS",
                "properties": {
                    "baseUrl": {
                        "deprecated": false,
                        "displayName": "Base URL",
                        "group": "common",
                        "javaType": "java.lang.String",
                        "kind": "parameter",
                        "labelHint": "Base Http Endpoint URL",
                        "placeholder": "eg 'www.redhat.com'",
                        "required": true,
                        "secret": false,
                        "type": "string"
                    }
                },
                "tags": ["verifier"],
                "version": 14
            },
            "connectorId": "https",
            "createdDate": 1622804931198,
            "description": "Invoke various HTTPS methods.",
            "icon": "assets:https.svg",
            "id": "i-MbLhX8zbX9wCwP3FX4nz",
            "isDerived": false,
            "lastUpdated": 1622804931198,
            "name": "store-kafka",
            "userId": "someone_important",
            "uses": 0
        }
    },
    "connectors": {
        ":https": {
            "actions": [{
                "actionType": "connector",
                "description": "Invoke an http endpoint URL",
                "descriptor": {
                    "connectorFactory": "io.syndesis.connector.http.HttpConnectorFactories$Https",
                    "inputDataShape": {
                        "kind": "any"
                    },
                    "outputDataShape": {
                        "kind": "any"
                    },
                    "propertyDefinitionSteps": [{
                        "description": "properties",
                        "name": "properties",
                        "properties": {
                            "httpMethod": {
                                "defaultValue": "GET",
                                "deprecated": false,
                                "displayName": "Http Method",
                                "enum": [{
                                    "label": "GET",
                                    "value": "GET"
                                }, {
                                    "label": "PUT",
                                    "value": "PUT"
                                }, {
                                    "label": "POST",
                                    "value": "POST"
                                }, {
                                    "label": "DELETE",
                                    "value": "DELETE"
                                }, {
                                    "label": "HEAD",
                                    "value": "HEAD"
                                }, {
                                    "label": "OPTIONS",
                                    "value": "OPTIONS"
                                }, {
                                    "label": "TRACE",
                                    "value": "TRACE"
                                }, {
                                    "label": "PATCH",
                                    "value": "PATCH"
                                }],
                                "group": "common",
                                "javaType": "java.lang.String",
                                "kind": "parameter",
                                "labelHint": "The specific http method to execute.",
                                "required": false,
                                "secret": false,
                                "type": "string"
                            },
                            "path": {
                                "deprecated": false,
                                "displayName": "URL Path",
                                "group": "common",
                                "javaType": "java.lang.String",
                                "kind": "parameter",
                                "labelHint": "Endpoint Path (eg '/path/to/endpoint')",
                                "required": false,
                                "secret": false,
                                "type": "string"
                            }
                        }
                    }]
                },
                "id": "io.syndesis.connector:connector-http:https-invoke-url",
                "name": "Invoke URL",
                "pattern": "To"
            }, {
                "actionType": "connector",
                "description": "Periodically invoke an http endpoint URL",
                "descriptor": {
                    "connectorCustomizers": ["io.syndesis.connector.http.HttpConnectorCustomizer"],
                    "connectorFactory": "io.syndesis.connector.http.HttpConnectorFactories$Https",
                    "inputDataShape": {
                        "kind": "none"
                    },
                    "outputDataShape": {
                        "kind": "any"
                    },
                    "propertyDefinitionSteps": [{
                        "description": "properties",
                        "name": "properties",
                        "properties": {
                            "httpMethod": {
                                "defaultValue": "GET",
                                "deprecated": false,
                                "displayName": "Http Method",
                                "enum": [{
                                    "label": "GET",
                                    "value": "GET"
                                }, {
                                    "label": "PUT",
                                    "value": "PUT"
                                }, {
                                    "label": "POST",
                                    "value": "POST"
                                }, {
                                    "label": "DELETE",
                                    "value": "DELETE"
                                }, {
                                    "label": "HEAD",
                                    "value": "HEAD"
                                }, {
                                    "label": "OPTIONS",
                                    "value": "OPTIONS"
                                }, {
                                    "label": "TRACE",
                                    "value": "TRACE"
                                }, {
                                    "label": "PATCH",
                                    "value": "PATCH"
                                }],
                                "group": "common",
                                "javaType": "java.lang.String",
                                "kind": "parameter",
                                "labelHint": "The specific http method to execute.",
                                "required": false,
                                "secret": false,
                                "type": "string"
                            },
                            "path": {
                                "deprecated": false,
                                "displayName": "URL Path",
                                "group": "common",
                                "javaType": "java.lang.String",
                                "kind": "parameter",
                                "labelHint": "Endpoint Path",
                                "placeholder": "eg '/path/to/endpoint'",
                                "required": false,
                                "secret": false,
                                "type": "string"
                            },
                            "schedulerExpression": {
                                "defaultValue": 1800000,
                                "deprecated": false,
                                "displayName": "Period",
                                "group": "consumer",
                                "javaType": "long",
                                "kind": "parameter",
                                "labelHint": "Delay between scheduling (executing).",
                                "required": false,
                                "secret": false,
                                "type": "duration"
                            }
                        }
                    }]
                },
                "id": "io.syndesis.connector:connector-http:https-periodic-invoke-url",
                "name": "Periodic invoke URL",
                "pattern": "From"
            }],
            "componentScheme": "https",
            "configuredProperties": {
                "headerFilterStrategy": "syndesisHeaderStrategy"
            },
            "dependencies": [{
                "id": "io.syndesis.connector:connector-http:2.0-SNAPSHOT",
                "type": "MAVEN"
            }],
            "description": "Invoke various HTTPS methods.",
            "icon": "assets:https.svg",
            "id": "https",
            "name": "HTTPS",
            "properties": {
                "baseUrl": {
                    "deprecated": false,
                    "displayName": "Base URL",
                    "group": "common",
                    "javaType": "java.lang.String",
                    "kind": "parameter",
                    "labelHint": "Base Http Endpoint URL",
                    "placeholder": "eg 'www.redhat.com'",
                    "required": true,
                    "secret": false,
                    "type": "string"
                }
            },
            "tags": ["verifier"],
            "version": 14
        },
        ":kafka": {
            "actions": [{
                "actionType": "connector",
                "description": "Publish data to the Kafka topic that you select.",
                "descriptor": {
                    "inputDataShape": {
                        "kind": "any"
                    },
                    "outputDataShape": {
                        "kind": "none"
                    },
                    "propertyDefinitionSteps": [{
                        "description": "Specify Kafka topic name",
                        "name": "Select the Kafka topic",
                        "properties": {
                            "topic": {
                                "componentProperty": false,
                                "deprecated": false,
                                "displayName": "Topic Name",
                                "group": "common",
                                "javaType": "java.lang.String",
                                "kind": "path",
                                "labelHint": "Select the Kafka topic to send data to.",
                                "order": 1,
                                "required": true,
                                "secret": false,
                                "type": "dataList"
                            }
                        }
                    }]
                },
                "id": "io.syndesis:kafka-publish-action",
                "name": "Publish",
                "pattern": "To",
                "tags": ["dynamic"]
            }, {
                "actionType": "connector",
                "description": "Receive data from the Kafka topic that you select.",
                "descriptor": {
                    "inputDataShape": {
                        "kind": "none"
                    },
                    "outputDataShape": {
                        "kind": "any"
                    },
                    "propertyDefinitionSteps": [{
                        "description": "Select the Kafka topic name",
                        "name": "Select the Kafka topic",
                        "properties": {
                            "topic": {
                                "componentProperty": false,
                                "deprecated": false,
                                "displayName": "Topic Name",
                                "group": "common",
                                "javaType": "java.lang.String",
                                "kind": "path",
                                "labelHint": "Select the Kafka topic to receive data from.",
                                "order": 1,
                                "required": true,
                                "secret": false,
                                "type": "dataList"
                            }
                        }
                    }]
                },
                "id": "io.syndesis:kafka-subscribe-action",
                "name": "Subscribe",
                "pattern": "From",
                "tags": ["dynamic"]
            }],
            "componentScheme": "kafka",
            "connectorCustomizers": ["io.syndesis.connector.kafka.KafkaConnectionCustomizer"],
            "dependencies": [{
                "id": "io.syndesis.connector:connector-kafka:2.0-SNAPSHOT",
                "type": "MAVEN"
            }],
            "description": "Subscribe for and publish messages",
            "icon": "assets:kafka.svg",
            "id": "kafka",
            "name": "Kafka Message Broker",
            "properties": {
                "brokerCertificate": {
                    "componentProperty": true,
                    "deprecated": false,
                    "displayName": "Broker certificate",
                    "group": "common,security",
                    "javaType": "java.lang.String",
                    "kind": "property",
                    "label": "security",
                    "labelHint": "TLS broker certificate",
                    "order": 3,
                    "required": false,
                    "secret": false,
                    "type": "textarea"
                },
                "brokers": {
                    "componentProperty": true,
                    "deprecated": false,
                    "displayName": "Kafka Broker URIs",
                    "group": "common",
                    "javaType": "java.lang.String",
                    "kind": "property",
                    "label": "common",
                    "labelHint": "Comma separated list of Kafka broker URIs in the form host:port",
                    "order": 1,
                    "required": true,
                    "secret": false,
                    "type": "typeahead"
                },
                "extraOptions": {
                    "arrayDefinition": {
                        "key": {
                            "displayName": "Key",
                            "type": "text"
                        },
                        "value": {
                            "displayName": "Value",
                            "type": "text"
                        }
                    },
                    "arrayDefinitionOptions": {
                        "i18nAddElementText": "Add",
                        "minElements": 0
                    },
                    "componentProperty": true,
                    "deprecated": false,
                    "displayName": "Extra Options",
                    "group": "common",
                    "javaType": "java.util.List",
                    "kind": "property",
                    "label": "common",
                    "labelHint": "Extra Options for the Kafka connection.",
                    "order": 4,
                    "type": "array"
                },
                "transportProtocol": {
                    "componentProperty": true,
                    "defaultValue": "PLAINTEXT",
                    "deprecated": false,
                    "displayName": "Transport Protocol",
                    "enum": [{
                        "label": "PLAIN",
                        "value": "PLAINTEXT"
                    }, {
                        "label": "TLS",
                        "value": "SSL"
                    }],
                    "group": "common,security",
                    "javaType": "java.lang.String",
                    "kind": "property",
                    "label": "security",
                    "labelHint": "The transport protocol. Select TLS for encryption in transit.",
                    "order": 2,
                    "required": true,
                    "secret": false,
                    "type": "string"
                }
            },
            "tags": ["dynamic", "verifier"],
            "version": 14
        }
    },
    "integrations": {
        ":i-MbLirmYbX9wCwP3FX4pz": {
            "createdAt": 1622805281955,
            "flows": [{
                "id": "-MbLhXzORECn7U95fZUC",
                "steps": [{
                    "action": {
                        "actionType": "connector",
                        "description": "Receive data from the Kafka topic that you select.",
                        "descriptor": {
                            "inputDataShape": {
                                "kind": "none"
                            },
                            "outputDataShape": {
                                "kind": "json-instance",
                                "metadata": {
                                    "userDefined": "true"
                                },
                                "name": "kafka服务端出参",
                                "specification": "{\"gj_system\":\"api_error_call\",\"message\":\"web_yaojisong,cart,/cart/api/cart/settle\",\"host\":[\"gateway-5cdc7c8784-79gxm\"],\"logger_name\":\"com.cowell.web.filter.CowellSendErrorFilter\",\"@version\":1,\"thread_name\":\"XNIO-2 task-446\",\"type\":\"syslog\",\"cluster_number\":\"k8s-test-tencent-01\",\"X-Span-Export\":\"true\",\"@timestamp\":\"2021-06-04T10:18:02.763Z\",\"level_value\":20000,\"level\":\"INFO\",\"X-B3-ParentSpanId\":\"65d4b56cbcf7cfa9\",\"env\":\"test\",\"version\":\"1.1.2.2076\",\"instance_name\":[\"gateway-5cdc7c8784-79gxm\"],\"X-B3-SpanId\":\"5cbb73511cea0301\",\"channel\":\"web_yaojisong\",\"uri\":\"/cart/api/cart/settle\",\"app_port\":\"8080\",\"request_method\":\"\",\"appName\":\"cart\",\"X-B3-TraceId\":\"785b7c36dceee8af65d4b56cbcf7cfa9\",\"app_name\":\"gateway\"}"
                            },
                            "propertyDefinitionSteps": [{
                                "description": "Select the Kafka topic name",
                                "name": "Select the Kafka topic",
                                "properties": {
                                    "topic": {
                                        "componentProperty": false,
                                        "dataList": ["DOCKER_FILEBEAT", "DOCKER_FLUENTD", "ELK_APACHE", "ELK_API_CALL", "ELK_API_EXCEPTION", "ELK_AUDIT", "ELK_BACKEND_AI_SUFFER_INFO_CHECKER", "ELK_BACKEND_PROD", "ELK_BDP_MDM", "ELK_CANAL", "ELK_CATALINA", "ELK_CDN", "ELK_CHECK", "ELK_CLB", "ELK_CVP_AUDIT", "ELK_CVP_BUSINESS_FLOW", "ELK_ECOLOGY", "ELK_ES_BACKUP", "ELK_ES_SEARCH_SLOW", "ELK_FLUME", "ELK_GOGS", "ELK_GRAFANA71", "ELK_HISTORY", "ELK_HYDEE_API", "ELK_INGRESS_NGINX_PROD", "ELK_INGRESS_NGINX_TEST", "ELK_JENKINS", "ELK_JIRA", "ELK_K8S_CONTROLLER_PROD", "ELK_K8S_EVENT", "ELK_LOG4J", "ELK_LOGSTASH_PLAIN", "ELK_MDM", "ELK_MESSAGE", "ELK_MQ_CALL", "ELK_MYSQL", "ELK_MYSQL_BACKUP", "ELK_NETWORK", "ELK_NGINX", "ELK_OFFICIAL", "ELK_OPEN_KAFKA", "ELK_ORACLE", "ELK_PGDB", "ELK_PROD_HISTORY", "ELK_PUBLIC_CORE_COLLECTOR_TEST", "ELK_REDIS", "ELK_REDIS_SLOWLOG", "ELK_SMS", "ELK_SMS_2020", "ELK_SMS_NEW", "ELK_STAGE_BACKEND_WEB-LOG", "ELK_STAGE_BACKEND_WEB-LOG-SYNC", "ELK_STAGE_BACKEND_WEB_LOG", "ELK_STAGE_BACKEND_WEB_LOG_SYNC", "ELK_TELEPHONE", "ELK_TENCENT_MYSQL_SLOWLOGS", "ELK_TEST_AI-FAQ-ASTHMA", "ELK_TEST_AI-MEDICAL-NER", "ELK_TEST_AI_ACCOUNT", "ELK_TEST_AI_ACITVITY", "ELK_TEST_AI_ADMIN", "ELK_TEST_AI_API", "ELK_TEST_AI_CENTER", "ELK_TEST_AI_CONTROL", "ELK_TEST_AI_DATA", "ELK_TEST_AI_DATA_API", "ELK_TEST_AI_DIALOG_CONTROL", "ELK_TEST_AI_DOCTOR", "ELK_TEST_AI_EXTERNAL", "ELK_TEST_AI_EXTERNAL_INFO_CHECKER", "ELK_TEST_AI_HUNT", "ELK_TEST_AI_INFO", "ELK_TEST_AI_JOB_ADMIN", "ELK_TEST_AI_LOGIN", "ELK_TEST_AI_MALL", "ELK_TEST_AI_MANAGER", "ELK_TEST_AI_MESSAGE", "ELK_TEST_AI_RECOMMAND_SCENES", "ELK_TEST_AI_RECOMMEND_SERVER", "ELK_TEST_AI_ROBOT_MANAGER", "ELK_TEST_AI_SCENARIO_SERVICE", "ELK_TEST_AI_SUFFER_INFO_CHECKER", "ELK_TEST_AI_TASK", "ELK_TEST_AI_TASK_MANAGER", "ELK_TEST_AI_TASK_RUNNER", "ELK_TEST_API_DEVOPS", "ELK_TEST_ASSETSCENTER", "ELK_TEST_AUTOTEST_SERVER", "ELK_TEST_BAM", "ELK_TEST_BASE_INFO", "ELK_TEST_BASIC_INTELLIGENT", "ELK_TEST_CART", "ELK_TEST_CBOARD", "ELK_TEST_CHATBOT_ACTION_SERVER", "ELK_TEST_CHRONICDISEASE", "ELK_TEST_CONFIG_SERVER", "ELK_TEST_CONFIG_SERVER_CVP", "ELK_TEST_CONVEYOR", "ELK_TEST_CUBE", "ELK_TEST_DIGITALSTORE", "ELK_TEST_ELEARNING", "ELK_TEST_EMR", "ELK_TEST_ERP_SAAS", "ELK_TEST_EXPRESS", "ELK_TEST_FOREST", "ELK_TEST_FUND", "ELK_TEST_GAEA", "ELK_TEST_GALAXY", "ELK_TEST_GATEWAY", "ELK_TEST_GATEWAY_YACE", "ELK_TEST_HADES", "ELK_TEST_HIS", "ELK_TEST_HIS_ASSIST_TOOL", "ELK_TEST_HIS_BASIC_DATA", "ELK_TEST_HIS_BIZ_TOOL", "ELK_TEST_HIS_INTELLIGENT", "ELK_TEST_HIS_ORDER", "ELK_TEST_HIS_PRESCRIPTION", "ELK_TEST_HIS_SEARCH", "ELK_TEST_HOTKEY_DASHBOARD", "ELK_TEST_HOTKEY_WORK", "ELK_TEST_HUIJIN_PLATFORM", "ELK_TEST_ISCM", "ELK_TEST_ITEMCENTER", "ELK_TEST_ITEMUPLOAD", "ELK_TEST_JHIPSTER_REGISTRY", "ELK_TEST_KEYCENTER", "ELK_TEST_MARKETING", "ELK_TEST_MDM-CLASSIFICATION", "ELK_TEST_MESSAGE", "ELK_TEST_MESSAGE_BUS", "ELK_TEST_MESSAGE_YD", "ELK_TEST_MM_CHRONICDISEASE", "ELK_TEST_MM_DIGITALSTORE", "ELK_TEST_MM_MEDICAL_CONTRACT", "ELK_TEST_NYUWA", "ELK_TEST_OMS", "ELK_TEST_ORDER", "ELK_TEST_ORDER-SYNC", "ELK_TEST_PAYCENTER", "ELK_TEST_PERFORMANCE", "ELK_TEST_PERMISSION", "ELK_TEST_POS", "ELK_TEST_PRICECENTER", "ELK_TEST_PROMOTION_BIZ_CP", "ELK_TEST_PURCHASE", "ELK_TEST_PY_CENTER_AI_BEAR", "ELK_TEST_PY_CENTER_AI_PAY_CENTER", "ELK_TEST_SAND", "ELK_TEST_SATELITE", "ELK_TEST_SCIB", "ELK_TEST_SCRM", "ELK_TEST_SEARCHAPI", "ELK_TEST_SECKILL", "ELK_TEST_SELFMALL", "ELK_TEST_SENTINEL_ADMIN", "ELK_TEST_SENTINEL_DASHBOARD", "ELK_TEST_SENTINEL_TOKEN_SERVER", "ELK_TEST_SOP_ADMIN", "ELK_TEST_SOP_GATEWAY", "ELK_TEST_SOP_OUT", "ELK_TEST_STOCKCENTER", "ELK_TEST_STORE", "ELK_TEST_TMS", "ELK_TEST_TOC", "ELK_TEST_UAA", "ELK_TEST_UMP", "ELK_TEST_WEB_LOG", "ELK_TEST_WXGATEWAY", "ELK_TEST_XXL_JOB", "ELK_TOMCAT", "ELK_VELERO", "ELK_YAO_JIAN", "ELK_ZIPKIN", "FRONTEND_API_PERF_TEST", "POS_ACTION_DATA_TEST", "SEC_NGINX", "business-flow-all", "sensor", "sleuth"],
                                        "deprecated": false,
                                        "displayName": "Topic Name",
                                        "group": "common",
                                        "javaType": "java.lang.String",
                                        "kind": "path",
                                        "labelHint": "Select the Kafka topic to receive data from.",
                                        "order": 1,
                                        "required": true,
                                        "secret": false,
                                        "type": "dataList"
                                    }
                                }
                            }]
                        },
                        "id": "io.syndesis:kafka-subscribe-action",
                        "name": "Subscribe",
                        "pattern": "From",
                        "tags": ["dynamic"]
                    },
                    "configuredProperties": {
                        "topic": "ELK_API_EXCEPTION"
                    },
                    "connection": {
                        "configuredProperties": {
                            "brokers": "10.8.183.126:9092,10.8.183.127:9092,10.8.183.128:9092",
                            "extraOptions": "[]",
                            "transportProtocol": "PLAINTEXT"
                        },
                        "connector": {
                            "actions": [{
                                "actionType": "connector",
                                "description": "Publish data to the Kafka topic that you select.",
                                "descriptor": {
                                    "inputDataShape": {
                                        "kind": "any"
                                    },
                                    "outputDataShape": {
                                        "kind": "none"
                                    },
                                    "propertyDefinitionSteps": [{
                                        "description": "Specify Kafka topic name",
                                        "name": "Select the Kafka topic",
                                        "properties": {
                                            "topic": {
                                                "componentProperty": false,
                                                "deprecated": false,
                                                "displayName": "Topic Name",
                                                "group": "common",
                                                "javaType": "java.lang.String",
                                                "kind": "path",
                                                "labelHint": "Select the Kafka topic to send data to.",
                                                "order": 1,
                                                "required": true,
                                                "secret": false,
                                                "type": "dataList"
                                            }
                                        }
                                    }]
                                },
                                "id": "io.syndesis:kafka-publish-action",
                                "name": "Publish",
                                "pattern": "To",
                                "tags": ["dynamic"]
                            }, {
                                "actionType": "connector",
                                "description": "Receive data from the Kafka topic that you select.",
                                "descriptor": {
                                    "inputDataShape": {
                                        "kind": "none"
                                    },
                                    "outputDataShape": {
                                        "kind": "any"
                                    },
                                    "propertyDefinitionSteps": [{
                                        "description": "Select the Kafka topic name",
                                        "name": "Select the Kafka topic",
                                        "properties": {
                                            "topic": {
                                                "componentProperty": false,
                                                "deprecated": false,
                                                "displayName": "Topic Name",
                                                "group": "common",
                                                "javaType": "java.lang.String",
                                                "kind": "path",
                                                "labelHint": "Select the Kafka topic to receive data from.",
                                                "order": 1,
                                                "required": true,
                                                "secret": false,
                                                "type": "dataList"
                                            }
                                        }
                                    }]
                                },
                                "id": "io.syndesis:kafka-subscribe-action",
                                "name": "Subscribe",
                                "pattern": "From",
                                "tags": ["dynamic"]
                            }],
                            "componentScheme": "kafka",
                            "connectorCustomizers": ["io.syndesis.connector.kafka.KafkaConnectionCustomizer"],
                            "dependencies": [{
                                "id": "io.syndesis.connector:connector-kafka:2.0-SNAPSHOT",
                                "type": "MAVEN"
                            }],
                            "description": "Subscribe for and publish messages",
                            "icon": "assets:kafka.svg",
                            "id": "kafka",
                            "name": "Kafka Message Broker",
                            "properties": {
                                "brokerCertificate": {
                                    "componentProperty": true,
                                    "deprecated": false,
                                    "displayName": "Broker certificate",
                                    "group": "common,security",
                                    "javaType": "java.lang.String",
                                    "kind": "property",
                                    "label": "security",
                                    "labelHint": "TLS broker certificate",
                                    "order": 3,
                                    "required": false,
                                    "secret": false,
                                    "type": "textarea"
                                },
                                "brokers": {
                                    "componentProperty": true,
                                    "deprecated": false,
                                    "displayName": "Kafka Broker URIs",
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "property",
                                    "label": "common",
                                    "labelHint": "Comma separated list of Kafka broker URIs in the form host:port",
                                    "order": 1,
                                    "required": true,
                                    "secret": false,
                                    "type": "typeahead"
                                },
                                "extraOptions": {
                                    "arrayDefinition": {
                                        "key": {
                                            "displayName": "Key",
                                            "type": "text"
                                        },
                                        "value": {
                                            "displayName": "Value",
                                            "type": "text"
                                        }
                                    },
                                    "arrayDefinitionOptions": {
                                        "i18nAddElementText": "Add",
                                        "minElements": 0
                                    },
                                    "componentProperty": true,
                                    "deprecated": false,
                                    "displayName": "Extra Options",
                                    "group": "common",
                                    "javaType": "java.util.List",
                                    "kind": "property",
                                    "label": "common",
                                    "labelHint": "Extra Options for the Kafka connection.",
                                    "order": 4,
                                    "type": "array"
                                },
                                "transportProtocol": {
                                    "componentProperty": true,
                                    "defaultValue": "PLAINTEXT",
                                    "deprecated": false,
                                    "displayName": "Transport Protocol",
                                    "enum": [{
                                        "label": "PLAIN",
                                        "value": "PLAINTEXT"
                                    }, {
                                        "label": "TLS",
                                        "value": "SSL"
                                    }],
                                    "group": "common,security",
                                    "javaType": "java.lang.String",
                                    "kind": "property",
                                    "label": "security",
                                    "labelHint": "The transport protocol. Select TLS for encryption in transit.",
                                    "order": 2,
                                    "required": true,
                                    "secret": false,
                                    "type": "string"
                                }
                            },
                            "tags": ["dynamic", "verifier"],
                            "version": 14
                        },
                        "connectorId": "kafka",
                        "createdDate": 1622700650276,
                        "description": "Subscribe for and publish messages",
                        "icon": "assets:kafka.svg",
                        "id": "i-MbFUiwa55rqfTUoRIMsz",
                        "isDerived": false,
                        "lastUpdated": 1622700650276,
                        "name": "测试环境的kafka",
                        "userId": "someone_important",
                        "uses": 0
                    },
                    "id": "-MbLiSy4RECn7U95fZUC",
                    "metadata": {
                        "configured": "true"
                    },
                    "stepKind": "endpoint"
                }, {
                    "action": {
                        "actionType": "step",
                        "descriptor": {
                            "inputDataShape": {
                                "kind": "any",
                                "name": "All preceding outputs"
                            },
                            "outputDataShape": {
                                "description": "application/json",
                                "kind": "json-instance",
                                "metadata": {
                                    "userDefined": "true"
                                },
                                "name": "store-kafka入参",
                                "specification": "{\"storeDtoOne\":\"xxx\",\"storeDtoThree\":\"xxx\",\"storeDtoTwo\":\"xxx\"}"
                            }
                        }
                    },
                    "configuredProperties": {
                        "atlasmapping": "{\"AtlasMapping\":{\"jsonType\":\"io.atlasmap.v2.AtlasMapping\",\"dataSource\":[{\"jsonType\":\"io.atlasmap.json.v2.JsonDataSource\",\"id\":\"-MbLiSy4RECn7U95fZUC\",\"name\":\"1 - kafka服务端出参\",\"description\":\"-MbLiSy4RECn7U95fZUC\",\"uri\":\"atlas:json:-MbLiSy4RECn7U95fZUC\",\"dataSourceType\":\"SOURCE\"},{\"jsonType\":\"io.atlasmap.json.v2.JsonDataSource\",\"id\":\"-MbLidI4RECn7U95fZUC\",\"name\":\"2 - store-kafka入参\",\"description\":\"application/json\",\"uri\":\"atlas:json:-MbLidI4RECn7U95fZUC\",\"dataSourceType\":\"TARGET\",\"template\":null}],\"mappings\":{\"mapping\":[{\"jsonType\":\"io.atlasmap.v2.Mapping\",\"id\":\"mapping.833951\",\"inputField\":[{\"jsonType\":\"io.atlasmap.json.v2.JsonField\",\"name\":\"type\",\"path\":\"/type\",\"fieldType\":\"STRING\",\"docId\":\"-MbLiSy4RECn7U95fZUC\",\"userCreated\":false}],\"outputField\":[{\"jsonType\":\"io.atlasmap.json.v2.JsonField\",\"name\":\"storeDtoOne\",\"path\":\"/storeDtoOne\",\"fieldType\":\"STRING\",\"docId\":\"-MbLidI4RECn7U95fZUC\",\"userCreated\":false}]},{\"jsonType\":\"io.atlasmap.v2.Mapping\",\"id\":\"mapping.980376\",\"inputField\":[{\"jsonType\":\"io.atlasmap.json.v2.JsonField\",\"name\":\"uri\",\"path\":\"/uri\",\"fieldType\":\"STRING\",\"docId\":\"-MbLiSy4RECn7U95fZUC\",\"userCreated\":false}],\"outputField\":[{\"jsonType\":\"io.atlasmap.json.v2.JsonField\",\"name\":\"storeDtoThree\",\"path\":\"/storeDtoThree\",\"fieldType\":\"STRING\",\"docId\":\"-MbLidI4RECn7U95fZUC\",\"userCreated\":false}]},{\"jsonType\":\"io.atlasmap.v2.Mapping\",\"id\":\"mapping.387849\",\"inputField\":[{\"jsonType\":\"io.atlasmap.json.v2.JsonField\",\"name\":\"version\",\"path\":\"/version\",\"fieldType\":\"STRING\",\"docId\":\"-MbLiSy4RECn7U95fZUC\",\"userCreated\":false}],\"outputField\":[{\"jsonType\":\"io.atlasmap.json.v2.JsonField\",\"name\":\"storeDtoTwo\",\"path\":\"/storeDtoTwo\",\"fieldType\":\"STRING\",\"docId\":\"-MbLidI4RECn7U95fZUC\",\"userCreated\":false}]}]},\"name\":\"UI.0\",\"lookupTables\":{\"lookupTable\":[]},\"constants\":{\"constant\":[]},\"properties\":{\"property\":[]}}}"
                    },
                    "id": "-MbLihztRECn7U95fZUC",
                    "metadata": {
                        "configured": "true"
                    },
                    "name": "Data Mapper",
                    "stepKind": "mapper"
                }, {
                    "action": {
                        "actionType": "connector",
                        "description": "Invoke an http endpoint URL",
                        "descriptor": {
                            "connectorFactory": "io.syndesis.connector.http.HttpConnectorFactories$Https",
                            "inputDataShape": {
                                "description": "application/json",
                                "kind": "json-instance",
                                "metadata": {
                                    "userDefined": "true"
                                },
                                "name": "store-kafka入参",
                                "specification": "{\"storeDtoOne\":\"xxx\",\"storeDtoThree\":\"xxx\",\"storeDtoTwo\":\"xxx\"}"
                            },
                            "outputDataShape": {
                                "kind": "any"
                            },
                            "propertyDefinitionSteps": [{
                                "description": "properties",
                                "name": "properties",
                                "properties": {
                                    "httpMethod": {
                                        "defaultValue": "GET",
                                        "deprecated": false,
                                        "displayName": "Http Method",
                                        "enum": [{
                                            "label": "GET",
                                            "value": "GET"
                                        }, {
                                            "label": "PUT",
                                            "value": "PUT"
                                        }, {
                                            "label": "POST",
                                            "value": "POST"
                                        }, {
                                            "label": "DELETE",
                                            "value": "DELETE"
                                        }, {
                                            "label": "HEAD",
                                            "value": "HEAD"
                                        }, {
                                            "label": "OPTIONS",
                                            "value": "OPTIONS"
                                        }, {
                                            "label": "TRACE",
                                            "value": "TRACE"
                                        }, {
                                            "label": "PATCH",
                                            "value": "PATCH"
                                        }],
                                        "group": "common",
                                        "javaType": "java.lang.String",
                                        "kind": "parameter",
                                        "labelHint": "The specific http method to execute.",
                                        "required": false,
                                        "secret": false,
                                        "type": "string"
                                    },
                                    "path": {
                                        "deprecated": false,
                                        "displayName": "URL Path",
                                        "group": "common",
                                        "javaType": "java.lang.String",
                                        "kind": "parameter",
                                        "labelHint": "Endpoint Path (eg '/path/to/endpoint')",
                                        "required": false,
                                        "secret": false,
                                        "type": "string"
                                    }
                                }
                            }]
                        },
                        "id": "io.syndesis.connector:connector-http:https-invoke-url",
                        "name": "Invoke URL",
                        "pattern": "To"
                    },
                    "configuredProperties": {
                        "httpMethod": "POST"
                    },
                    "connection": {
                        "configuredProperties": {
                            "baseUrl": "https://api-test-internal.gaojihealth.cn/store/api/public/test/kafka"
                        },
                        "connector": {
                            "actions": [{
                                "actionType": "connector",
                                "description": "Invoke an http endpoint URL",
                                "descriptor": {
                                    "connectorFactory": "io.syndesis.connector.http.HttpConnectorFactories$Https",
                                    "inputDataShape": {
                                        "kind": "any"
                                    },
                                    "outputDataShape": {
                                        "kind": "any"
                                    },
                                    "propertyDefinitionSteps": [{
                                        "description": "properties",
                                        "name": "properties",
                                        "properties": {
                                            "httpMethod": {
                                                "defaultValue": "GET",
                                                "deprecated": false,
                                                "displayName": "Http Method",
                                                "enum": [{
                                                    "label": "GET",
                                                    "value": "GET"
                                                }, {
                                                    "label": "PUT",
                                                    "value": "PUT"
                                                }, {
                                                    "label": "POST",
                                                    "value": "POST"
                                                }, {
                                                    "label": "DELETE",
                                                    "value": "DELETE"
                                                }, {
                                                    "label": "HEAD",
                                                    "value": "HEAD"
                                                }, {
                                                    "label": "OPTIONS",
                                                    "value": "OPTIONS"
                                                }, {
                                                    "label": "TRACE",
                                                    "value": "TRACE"
                                                }, {
                                                    "label": "PATCH",
                                                    "value": "PATCH"
                                                }],
                                                "group": "common",
                                                "javaType": "java.lang.String",
                                                "kind": "parameter",
                                                "labelHint": "The specific http method to execute.",
                                                "required": false,
                                                "secret": false,
                                                "type": "string"
                                            },
                                            "path": {
                                                "deprecated": false,
                                                "displayName": "URL Path",
                                                "group": "common",
                                                "javaType": "java.lang.String",
                                                "kind": "parameter",
                                                "labelHint": "Endpoint Path (eg '/path/to/endpoint')",
                                                "required": false,
                                                "secret": false,
                                                "type": "string"
                                            }
                                        }
                                    }]
                                },
                                "id": "io.syndesis.connector:connector-http:https-invoke-url",
                                "name": "Invoke URL",
                                "pattern": "To"
                            }, {
                                "actionType": "connector",
                                "description": "Periodically invoke an http endpoint URL",
                                "descriptor": {
                                    "connectorCustomizers": ["io.syndesis.connector.http.HttpConnectorCustomizer"],
                                    "connectorFactory": "io.syndesis.connector.http.HttpConnectorFactories$Https",
                                    "inputDataShape": {
                                        "kind": "none"
                                    },
                                    "outputDataShape": {
                                        "kind": "any"
                                    },
                                    "propertyDefinitionSteps": [{
                                        "description": "properties",
                                        "name": "properties",
                                        "properties": {
                                            "httpMethod": {
                                                "defaultValue": "GET",
                                                "deprecated": false,
                                                "displayName": "Http Method",
                                                "enum": [{
                                                    "label": "GET",
                                                    "value": "GET"
                                                }, {
                                                    "label": "PUT",
                                                    "value": "PUT"
                                                }, {
                                                    "label": "POST",
                                                    "value": "POST"
                                                }, {
                                                    "label": "DELETE",
                                                    "value": "DELETE"
                                                }, {
                                                    "label": "HEAD",
                                                    "value": "HEAD"
                                                }, {
                                                    "label": "OPTIONS",
                                                    "value": "OPTIONS"
                                                }, {
                                                    "label": "TRACE",
                                                    "value": "TRACE"
                                                }, {
                                                    "label": "PATCH",
                                                    "value": "PATCH"
                                                }],
                                                "group": "common",
                                                "javaType": "java.lang.String",
                                                "kind": "parameter",
                                                "labelHint": "The specific http method to execute.",
                                                "required": false,
                                                "secret": false,
                                                "type": "string"
                                            },
                                            "path": {
                                                "deprecated": false,
                                                "displayName": "URL Path",
                                                "group": "common",
                                                "javaType": "java.lang.String",
                                                "kind": "parameter",
                                                "labelHint": "Endpoint Path",
                                                "placeholder": "eg '/path/to/endpoint'",
                                                "required": false,
                                                "secret": false,
                                                "type": "string"
                                            },
                                            "schedulerExpression": {
                                                "defaultValue": 1800000,
                                                "deprecated": false,
                                                "displayName": "Period",
                                                "group": "consumer",
                                                "javaType": "long",
                                                "kind": "parameter",
                                                "labelHint": "Delay between scheduling (executing).",
                                                "required": false,
                                                "secret": false,
                                                "type": "duration"
                                            }
                                        }
                                    }]
                                },
                                "id": "io.syndesis.connector:connector-http:https-periodic-invoke-url",
                                "name": "Periodic invoke URL",
                                "pattern": "From"
                            }],
                            "componentScheme": "https",
                            "configuredProperties": {
                                "headerFilterStrategy": "syndesisHeaderStrategy"
                            },
                            "dependencies": [{
                                "id": "io.syndesis.connector:connector-http:2.0-SNAPSHOT",
                                "type": "MAVEN"
                            }],
                            "description": "Invoke various HTTPS methods.",
                            "icon": "assets:https.svg",
                            "id": "https",
                            "name": "HTTPS",
                            "properties": {
                                "baseUrl": {
                                    "deprecated": false,
                                    "displayName": "Base URL",
                                    "group": "common",
                                    "javaType": "java.lang.String",
                                    "kind": "parameter",
                                    "labelHint": "Base Http Endpoint URL",
                                    "placeholder": "eg 'www.redhat.com'",
                                    "required": true,
                                    "secret": false,
                                    "type": "string"
                                }
                            },
                            "tags": ["verifier"],
                            "version": 14
                        },
                        "connectorId": "https",
                        "createdDate": 1622804931198,
                        "description": "Invoke various HTTPS methods.",
                        "icon": "assets:https.svg",
                        "id": "i-MbLhX8zbX9wCwP3FX4nz",
                        "isDerived": false,
                        "lastUpdated": 1622804931198,
                        "name": "store-kafka",
                        "userId": "someone_important",
                        "uses": 0
                    },
                    "id": "-MbLidI4RECn7U95fZUC",
                    "metadata": {
                        "configured": "true"
                    },
                    "stepKind": "endpoint"
                }],
                "tags": ["i-MbFUiwa55rqfTUoRIMsz", "i-MbLhX8zbX9wCwP3FX4nz"],
                "type": "PRIMARY"
            }],
            "id": "i-MbLirmYbX9wCwP3FX4pz",
            "name": "store-kafka-001",
            "tags": ["https", "kafka"],
            "updatedAt": 0,
            "version": 1
        }
    }
}

The error is:

org.apache.camel.FailedToCreateRouteException: Failed to create route -MbLhXzORECn7U95fZUC: Route(-MbLhXzORECn7U95fZUC)[From[kafka-0-0-i-MbLirmYbX9wCwP3... because of No endpoint could be found for: kafka-kafka-0-0-i-MbLirmYbX9wCwP3FX4pz, please check your classpath contains the needed Camel component jar.
    at org.apache.camel.reifier.RouteReifier.createRoute(RouteReifier.java:123) ~[camel-core-engine-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.DefaultCamelContext.startRouteDefinitions(DefaultCamelContext.java:368) ~[camel-core-engine-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.DefaultCamelContext.startRouteDefinitions(DefaultCamelContext.java:342) ~[camel-core-engine-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.engine.AbstractCamelContext.doInit(AbstractCamelContext.java:2613) ~[camel-base-3.4.4.jar:3.4.4]
    at org.apache.camel.support.service.BaseService.init(BaseService.java:83) ~[camel-api-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.engine.AbstractCamelContext.init(AbstractCamelContext.java:2436) ~[camel-base-3.4.4.jar:3.4.4]
    at org.apache.camel.support.service.BaseService.start(BaseService.java:111) ~[camel-api-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.engine.AbstractCamelContext.start(AbstractCamelContext.java:2453) ~[camel-base-3.4.4.jar:3.4.4]
    at org.apache.camel.spring.SpringCamelContext.start(SpringCamelContext.java:121) ~[camel-spring-3.4.4.jar:3.4.4]
    at org.apache.camel.spring.SpringCamelContext.onApplicationEvent(SpringCamelContext.java:157) ~[camel-spring-3.4.4.jar:3.4.4]
    at org.springframework.context.event.SimpleApplicationEventMulticaster.doInvokeListener(SimpleApplicationEventMulticaster.java:172) ~[spring-context-5.2.9.RELEASE.jar:5.2.9.RELEASE]
    at org.springframework.context.event.SimpleApplicationEventMulticaster.invokeListener(SimpleApplicationEventMulticaster.java:165) ~[spring-context-5.2.9.RELEASE.jar:5.2.9.RELEASE]
    at org.springframework.context.event.SimpleApplicationEventMulticaster.multicastEvent(SimpleApplicationEventMulticaster.java:139) ~[spring-context-5.2.9.RELEASE.jar:5.2.9.RELEASE]
    at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:404) ~[spring-context-5.2.9.RELEASE.jar:5.2.9.RELEASE]
    at org.springframework.context.support.AbstractApplicationContext.publishEvent(AbstractApplicationContext.java:361) ~[spring-context-5.2.9.RELEASE.jar:5.2.9.RELEASE]
    at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:898) ~[spring-context-5.2.9.RELEASE.jar:5.2.9.RELEASE]
    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:554) ~[spring-context-5.2.9.RELEASE.jar:5.2.9.RELEASE]
    at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:143) ~[spring-boot-2.3.4.RELEASE.jar:2.3.4.RELEASE]
    at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:758) ~[spring-boot-2.3.4.RELEASE.jar:2.3.4.RELEASE]
    at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:750) ~[spring-boot-2.3.4.RELEASE.jar:2.3.4.RELEASE]
    at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:397) ~[spring-boot-2.3.4.RELEASE.jar:2.3.4.RELEASE]
    at org.springframework.boot.SpringApplication.run(SpringApplication.java:315) ~[spring-boot-2.3.4.RELEASE.jar:2.3.4.RELEASE]
    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1237) ~[spring-boot-2.3.4.RELEASE.jar:2.3.4.RELEASE]
    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1226) ~[spring-boot-2.3.4.RELEASE.jar:2.3.4.RELEASE]
    at io.syndesis.example.Application.main(Application.java:13) ~[classes/:na]
Caused by: org.apache.camel.NoSuchEndpointException: No endpoint could be found for: kafka-kafka-0-0-i-MbLirmYbX9wCwP3FX4pz, please check your classpath contains the needed Camel component jar.
    at org.apache.camel.impl.engine.AbstractCamelContext.doGetEndpoint(AbstractCamelContext.java:831) ~[camel-base-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.engine.AbstractCamelContext.getEndpoint(AbstractCamelContext.java:768) ~[camel-base-3.4.4.jar:3.4.4]
    at io.syndesis.integration.component.proxy.ComponentProxyComponent.createDelegateEndpoint(ComponentProxyComponent.java:390) ~[integration-component-proxy-2.0-SNAPSHOT.jar:2.0-SNAPSHOT]
    at io.syndesis.integration.component.proxy.ComponentProxyComponent.createEndpoint(ComponentProxyComponent.java:146) ~[integration-component-proxy-2.0-SNAPSHOT.jar:2.0-SNAPSHOT]
    at org.apache.camel.support.DefaultComponent.createEndpoint(DefaultComponent.java:237) ~[camel-support-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.engine.AbstractCamelContext.doGetEndpoint(AbstractCamelContext.java:846) ~[camel-base-3.4.4.jar:3.4.4]
    at org.apache.camel.impl.engine.AbstractCamelContext.getEndpoint(AbstractCamelContext.java:768) ~[camel-base-3.4.4.jar:3.4.4]
    at org.apache.camel.support.CamelContextHelper.getMandatoryEndpoint(CamelContextHelper.java:58) ~[camel-support-3.4.4.jar:3.4.4]
    at org.apache.camel.reifier.AbstractReifier.resolveEndpoint(AbstractReifier.java:177) ~[camel-core-engine-3.4.4.jar:3.4.4]
    at org.apache.camel.reifier.RouteReifier.doCreateRoute(RouteReifier.java:259) ~[camel-core-engine-3.4.4.jar:3.4.4]
    at org.apache.camel.reifier.RouteReifier.createRoute(RouteReifier.java:117) ~[camel-core-engine-3.4.4.jar:3.4.4]
    ... 24 common frames omitted

image

image

image

zregvart commented 3 years ago

This seems to be using version 2.x of Syndesis, which is not stable. Would you be willing to try with 1.x version instead?

suoxun commented 3 years ago

This seems to be using version 2.x of Syndesis, which is not stable. Would you be willing to try with 1.x version instead?

Because I took over other people's projects and continued to work, it is estimated that he should have used version 2. X before. The following is a screenshot of pom.xml under the app. Do you want to see if it is 2. X.

image

suoxun commented 3 years ago

This seems to be using version 2.x of Syndesis, which is not stable. Would you be willing to try with 1.x version instead?

Let me ask you a few more questions:

  1. If don't use the 1. X version, how can Kafka solve this problem

  2. If don't use the 1. X version, it's not just Kafka. Is there any other component connection problem

  3. If I want to use version 1. X, which specific version 1. X do you recommend

zregvart commented 3 years ago
  • If don't use the 1. X version, how can Kafka solve this problem

I sorry, I don't understand what you're asking here

  • If don't use the 1. X version, it's not just Kafka. Is there any other component connection problem

There is a great difference in how 2.x deploys and runs integrations compared to 1.x, and because of that almost all connectors could be affected. To what extend it is hard to tell (for me).

  • If I want to use version 1. X, which specific version 1. X do you recommend

Use the latest non-prerelease 1.x version, which at the moment is 1.11, I think we're close to releasing 1.12 as well. This URL should point to a stable version: https://github.com/syndesisio/syndesis/releases/latest

suoxun commented 3 years ago
  • If don't use the 1. X version, how can Kafka solve this problem

I sorry, I don't understand what you're asking here

  • If don't use the 1. X version, it's not just Kafka. Is there any other component connection problem

There is a great difference in how 2.x deploys and runs integrations compared to 1.x, and because of that almost all connectors could be affected. To what extend it is hard to tell (for me).

  • If I want to use version 1. X, which specific version 1. X do you recommend

Use the latest non-prerelease 1.x version, which at the moment is 1.11, I think we're close to releasing 1.12 as well. This URL should point to a stable version: https://github.com/syndesisio/syndesis/releases/latest

If I use the 1.x version, do you think it will be a problem to create a kafka integration?

zregvart commented 3 years ago

If I use the 1.x version, do you think it will be a problem to create a kafka integration?

The issue here seems to be in publishing and running the route, this should not be an issue on 1.x.

suoxun commented 3 years ago

If I use the 1.x version, do you think it will be a problem to create a kafka integration?

The issue here seems to be in publishing and running the route, this should not be an issue on 1.x.

thank you very much

zregvart commented 3 years ago

I’m closing this feel free to reopen or create a followup issue if you think something was left out.