kite-sdk / kite

Kite SDK
http://kitesdk.org/docs/current/
Apache License 2.0
394 stars 263 forks source link

Create HBase Dataset ERROR #465

Open kchen0x opened 7 years ago

kchen0x commented 7 years ago

When I tried to create a HBase dataset:

kite-dataset create dataset:hbase:10.0.1.214:2181/sensor -s sensorRecord.avsc -p partition.json -m map.json

it returns:

IO error: Cannot open schema table

Those are my config files:

schema:

{
  "fields": [
    { "name": "timestamp", "type": "long" },
    { "name": "sensor_group", "type": "string" },
    { "name": "sensor", "type": "string" },
    { "name": "uuid", "type": "string"},
    { "name": "value", "type": "string" },
    { "name": "src", "type": "string"}
  ],
  "name": "sensorRecord",
  "type": "record"
}

partition:

[
  {"type": "identity", "source": "timestamp"},
  {"type": "year",     "source": "timestamp"},
  {"type": "month",    "source": "timestamp"},
  {"type": "day",      "source": "timestamp"},
  {"type": "hour",     "source": "timestamp"}
]

mapping:

[ {
  "source" : "timestamp",
  "type" : "key"
}, {
  "source" : "sensor_group",
  "type" : "column",
  "family" : "v",
  "qualifier" : "sensor_group"
}, {
  "source" : "sensor",
  "type" : "column",
  "family" : "v",
  "qualifier" : "sensor"
}, {
  "source" : "uuid",
  "type" : "column",
  "family" : "v",
  "qualifier" : "uuid"
}, {
  "source" : "value",
  "type" : "column",
  "family" : "v",
  "qualifier" : "value"
}, {
  "source" : "src",
  "type" : "column",
  "family" : "v",
  "qualifier" : "src"
} ]