kakao / s2graph

This code base is retained for historical interest only, please visit Apache Incubator Repo for latest one
https://github.com/apache/incubator-s2graph
Other
250 stars 32 forks source link

Feature/loader hive external table compatability #76

Closed emesday closed 9 years ago

emesday commented 9 years ago
change outPath, compatible with Hive ext. table

add the resolver for scalaz

and change outputPath as date_id=$date_id/ts=$ts

for create external table as

    CREATE EXTERNAL TABLE wal(
      log_ts bigint,
      o string,
      lt string,
      f string, -- from or id
      t string, -- to or service
      l string, -- label or column
      p string, -- props, if service is null, this values is the service and the props is null
      s string  -- service, can be null, then the props is the service
    )
    PARTITIONED BY (
      date_id string,
      ts string
    )
    ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t'
    LOCATION "/path/to/wal";

then add partitions as

    ALTER TABLE wal ADD PARTITION(date_id='2015-09-08', ts='1441699800000');