feathr-ai / feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise
https://join.slack.com/t/feathrai/shared_invite/zt-1ffva5u6v-voq0Us7bbKAw873cEzHOSg
Apache License 2.0
1.99k stars 260 forks source link

Support high-dimensional tensor in derivations #1172

Closed jaymo001 closed 1 year ago

jaymo001 commented 1 year ago

Description

Support high-dimensional tensor in derivations, e.g. derivations: { featureWithNullDerived:{ key: ["id"] inputs: { fv: {key: ["id"], feature: featureWithNull} } definition.sqlExpr: "coalesce(fv, ARRAY(ARRAY(\"aa\", \"bb\", \"cc\", \"dd\", \"ee\"), ARRAY(\"UNK\", \"UNK\", \"UNK\", \"UNK\", \"UNK\")))" type: { type: TENSOR tensorCategory: DENSE shape: [2,5] dimensionType: [INT, INT] valType: STRING } } }