search

keedio / flume-ng-sql-source

Flume Source to import data from SQL Databases
Apache License 2.0
264 stars 164 forks source link

delimiter of the incoming data from mysql #31

Closed simran-k closed 7 years ago

simran-k commented 7 years ago

I see that the data is delimited by comma. I do have comma in my values as well and that seems to break the format.

Is there a way I can use some other delimiter ? I am using hive as a sink and that requires me to specify the delimiter of my incoming data.

This:

serializer.delimiter , (Type: string) The field delimiter in the incoming data. To use special characters, surround them with double quotes like “\t”.

It also needs me to make sure that this delimiter is not in the data values

lufeng1102 commented 7 years ago

Hi simran-k, I have also meet this issue. Do you already solve this issue?

lufeng1102 commented 7 years ago

I have add a patch for this issue. Feel free to review it. https://github.com/keedio/flume-ng-sql-source/pull/32

mvalleavila commented 7 years ago

Thanks @lufeng1102 !!