keedio / flume-ng-sql-source

Flume Source to import data from SQL Databases
Apache License 2.0
264 stars 164 forks source link

delimiter is no effect #43

Closed starbow727 closed 7 years ago

starbow727 commented 7 years ago

hello, agent.sources.sqlSource.delimiter.entry = ~ This delimiter is used to split the database records? But it is no effect.The fields of the database are also separated by commas. I try to change the source code. private static final String DEFAULT_DELIMITER_ENTRY = "~"; Still no effect a1.sources.s1.delimiter.entry= ~

define channels

a1.channels.c1.type = file

define sinks

a1.sinks.k1.type = hbase a1.sinks.k1.table = zyb:scenic a1.sinks.k1.columnFamily = info a1.sinks.k1.serializer = org.apache.flume.sink.hbase.RegexHbaseEventSerializer a1.sinks.k1.serializer.regex=^([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+),([^~]+) a1.sinks.k1.serializer.colNames=id,name,code,sys_picture_id,sys_description_id,description,sys_area_code,address,sys_gpis_id,create_by,create_time,modify_by,modify_time,deleted,corp_code,corp_group_code,enabled,top_hits,start_time,end_time,tel,lon,lat,rank,authority_corp_code,label_id,attr_type