housepower / clickhouse_sinker

Easily load data from kafka to ClickHouse
https://housepower.github.io/clickhouse_sinker
Apache License 2.0
514 stars 118 forks source link

How can I new multi task in on clickhouse_sinker #157

Closed hasylu closed 2 years ago

hasylu commented 2 years ago

just like config.json

task:{} => task:[ {}, {} ]

or any other solution.

yuzhichang commented 2 years ago

The config contains a single task or multiple tasks.

type Config struct {
    Kafka      KafkaConfig
    Clickhouse ClickHouseConfig
    Task       *TaskConfig
    Tasks      []*TaskConfig
    Assignment Assignment
    LogLevel   string
}
hasylu commented 2 years ago

@yuzhichang Thanks