search

StarRocks / starrocks

StarRocks, a Linux Foundation project, is a next-generation sub-second MPP OLAP database for full analytics scenarios, including multi-dimensional analytics, real-time analytics, and ad-hoc queries.
https://starrocks.io
Apache License 2.0
8.56k stars 1.73k forks source link

hive catalog CSV #28275

Closed YannngHQ closed 4 weeks ago

YannngHQ commented 1 year ago

table format: CREATE EXTERNAL TABLE db.name( a string COMMENT 'from deserializer', b string COMMENT 'from deserializer', c string COMMENT 'from deserializer') PARTITIONED BY ( dt string) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde' WITH SERDEPROPERTIES ( 'escapeChar'='\', 'quoteChar'='"', 'separatorChar'=',', 'serialization.encoding'='GBK') STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat' LOCATION 'xxx'

If the create table statement is specified like this, the specifications of separatorChar and quoteChar do not take effect. Version: 3.1.

jaogoy commented 1 year ago

@YannngHQ you create external in Hive or StarRocks?

wwa132 commented 7 months ago

Just for reference, plz take a try here to see if the community has already provided a solution https://starrocks.snowshoe.dev/search?q=hive+catalog+CSV

github-actions[bot] commented 1 month ago

We have marked this issue as stale because it has been inactive for 6 months. If this issue is still relevant, removing the stale label or adding a comment will keep it active. Otherwise, we'll close it in 10 days to keep the issue queue tidy. Thank you for your contribution to StarRocks!