search

feathr-ai / feathr

Feathr – A scalable, unified data and AI engineering platform for enterprise
https://join.slack.com/t/feathrai/shared_invite/zt-1ffva5u6v-voq0Us7bbKAw873cEzHOSg
Apache License 2.0
1.99k stars 260 forks source link

Support #LATEST and timePartitionPattern at the same time #1198

Closed jaymo001 closed 1 year ago

jaymo001 commented 1 year ago

Description

Support #LATEST and timePartitionPattern at the same time.

e.g. sources: { swaSource: { location: { path: "src/test/resources/slidingWindowAgg/localSWAAnchorTestFeatureData/daily/yyyy/MM/dd/postfixPath/#LATEST" } timePartitionPattern: "yyyy/MM/dd" } }
anchors: {
swaAnchor: {
source: "swaSource"
key: "id"
features: {
f1: {
def: "int_value"
window: 3d
aggregation: LATEST
}
}
}
}