ogrodnek / csv-serde

Hive SerDe for CSV
Apache License 2.0
141 stars 80 forks source link

matching properties of serde #48

Open shantanuo opened 2 years ago

shantanuo commented 2 years ago

It seems that I am able to create tables with invalid properties. For e.g. "some_junk" is not valid property of csv serialization. The statement should fail.

CREATE EXTERNAL TABLE test2 (
f1 string,
s2 string) 
ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde' 
WITH SERDEPROPERTIES ("some_junk" = ",", "escapeChar" = "\\") 
LOCATION 's3://DOC-EXAMPLE-BUCKET/dataset/test1/'

I was expecting an error because of "some_junk". But the statement was executed successfully.

shantanuo commented 2 years ago

Raising an issue as suggested in the comments of this thread...

https://stackoverflow.com/questions/72908311/matching-properties-of-serde