The lookup operator is the second operator next to enrich that utilizes contexts. It does live- and retro-lookups with a context against the node's storage.
Contexts gain a new (optional) capability to provide a feed of expressions from updates. For contexts that support this option, the lookup operator additionally supports retro-matching.
Lookup subscribes to new partitions from the catalog, and uses a context for enriching and filtering. Lookup queries the catalog for old partitions with the expressions provided by the context, and uses a context for enriching and filtering.
The syntax for the lookup operator matches the syntax of the enrich operator. For example, for a lookup-table context, the following syntax applies:
By default, both retro and live lookups are enabled. Specifying either --retro or --live explicitly disables the other. Specifying both leaves both enabled.
### Definition of Done
- [x] Implement the `lookup` operator
The
lookupoperator is the second operator next toenrichthat utilizes contexts. It does live- and retro-lookups with a context against the node's storage.Contexts gain a new (optional) capability to provide a feed of expressions from updates. For contexts that support this option, the lookup operator additionally supports retro-matching.
Lookup subscribes to new partitions from the catalog, and uses a context for enriching and filtering. Lookup queries the catalog for old partitions with the expressions provided by the context, and uses a context for enriching and filtering.
The syntax for the
lookupoperator matches the syntax of theenrichoperator. For example, for alookup-tablecontext, the following syntax applies:By default, both retro and live lookups are enabled. Specifying either
--retroor--liveexplicitly disables the other. Specifying both leaves both enabled.