dbeatty10
commented
1 month ago Thanks for reaching out @juliodias20 !
Special characters worked for me when I tried with dbt-duckdb, so this might be specific to the dbt-athena-community adapter rather than dbt-core. So I'm going to transfer this issue to that repository instead.
Example
See below for my output when using dbt-duckdb.
Create this file:
seeds/my_seed.csv
id,some_text
1,ABC
2,Ã Á Í ÇRun these commands:
dbt seed
dbt show --inline 'select * from {{ ref("my_seed") }}'See this output:
| id | some_text |
| -- | --------- |
| 1 | ABC |
| 2 | Ã Á Í Ç |
juliodias20
e-quili
CommonCrisis
Is this a new bug in dbt-core?
Current Behavior
I would like to start by apologizing if there is already a bug report on this subject, but I couldn't find it.
Lets go, I have a .csv file (sds_teste.csv) that I am using as a seed, like this:
So, I execute the command
dbt seed -s sds_testeand the dbt is successful executedBut, when i execute a
selectto see the table created by dbt seed command, I can see that the table cannot read the special characters (accented letters)I already try some things that I found around de internet, like to pass the
encoding: utf-8, but i not found nothing that working.My profiles.yml
Expected Behavior
The expected behavir is that the dbt seed would can read a .csv file in encoding utf-8.
Should be:
A text with special characters, like Ã, Á, Í, or ÇInstead of:A text with special characters, like �, �, �, or �Steps To Reproduce
1 - Install the python 3.11.9 in a windows computer 2 - Create a python environment with
python venv3 - Installdbt-core==1.8.7anddbt-athena-community==1.8.4bypip install4 - Create a dbt project 5 - Create a .csv file in the folderseeds/and write some example with special characters 6 - Configure the profile.yml to connect aAWS Athena(storage:AWS S3) 7 - Run thedbt seedcommandRelevant log output
Environment
Which database adapter are you using with dbt?
other (mention it in "Additional Context")
Additional Context
No response