td:create_table option for WITH statement doesn't work for Hive

treasure-data / digdag

Workload Automation System

https://www.digdag.io/

Apache License 2.0

1.3k stars 221 forks source link

td:create_table option for WITH statement doesn't work for Hive #16

Closed xerial closed 8 years ago

xerial commented 8 years ago

INSERT OVERWRITE TABLE (table) WITH ... is not supported in Hive.

frsyuki commented 8 years ago

omg

xerial commented 8 years ago

If nesting with clauses is possible in Hive, we can rewrite the query as with result as (with ...) insert overwrite table (table) select * from result

xerial commented 8 years ago

Nested with statement doesn't work in hive...

frsyuki commented 8 years ago

8dc39fd20bdae5e2da53f9e8f1be311e616a1104 implements a workaround... Users need to add --DIGDAG_INSERT_LINE to the query file to use create_table if engine: hive and query includes WITH.