Issue Loading chinese characters from Snowflake to SQL Server

slingdata-io / sling-cli

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database.

https://docs.slingdata.io

GNU General Public License v3.0

444 stars 34 forks source link

Open kkprab opened 3 days ago

kkprab commented 3 days ago

I am trying to load data from Snowflake to SQL Server In SQL Server column value with chinease characters transformed to ???? (question marks)

Sample below

in Snowflake we see the charaters

in config file i have tried with encode or decode UTF8 but no success

Can you plz suggest what configuration we try

flarco commented 3 days ago

A few questions:

What version of sling are you using?
Are you loading into SQL Server with bcp?
- if so, can you try without bulk (target_options: { use_bulk: false }).
can you try the cli to stdout to see if the characters show OK? sling run --src-conn core_dev --src-stream dev.table --limit 10 --stdout

kkprab commented 3 days ago

Thanks Flarco

Using sling version 1.2.22
Tried with use_bulk: false still showing ??? instead of chinese characters
While running cli as you have suggested and i can see chinese characters in the output