Closed sagar-salvi-apptware closed 6 days ago
Things to confirm:
Cassandra Data Type | DataHub Data Type |
---|---|
ascii | StringType |
bigint | NumberType |
blob | BytesType |
boolean | BooleanType |
counter | NumberType |
date | DateType |
decimal | NumberType |
double | NumberType |
float | NumberType |
inet | StringType |
int | NumberType |
list | ArrayType |
map | MapType |
set | ArrayType |
smallint | NumberType |
text | StringType |
time | TimeType |
timestamp | DateType |
timeuuid | StringType |
tinyint | NumberType |
tuple | ArrayType |
uuid | StringType |
varchar | StringType |
varint | NumberType |
frozen<map<text, text>> | MapType |
frozen<list |
ArrayType |
frozen<set |
ArrayType |
set<?> -> ArrayType list<?> -> ArrayType map<?> -> MapType
And UDT -> Flattened structure
Views & Tables should have the same aspects
And ensure we have table + column comments as description fields.
.....And
Views have
Table + Column Comments should be QA'd locally.
Also please make sure error handling is clear. And try-excepts are around areas where we need. This connector should only fail in known cases. We should not have ANY uncaught exceptions!
Checklist