Closed kkrugler closed 6 years ago
I think we'd have to change UrlDBFunction from a ProcessFunction to a CoProcessFunction.
UrlDBFunction
ProcessFunction
The input would be Tuple2<String, Float> with PLD and average page score, which we'd use to adjust how many URLs we emit for a domain.
Tuple2<String, Float>
PLD
average page score
It's likely we'd want to save this as state, though I'm curious how state management works with a CoProcessFunction.
CoProcessFunction
I think we'd have to change
UrlDBFunctionfrom aProcessFunctionto a CoProcessFunction.The input would be
Tuple2<String, Float>withPLDandaverage page score, which we'd use to adjust how many URLs we emit for a domain.It's likely we'd want to save this as state, though I'm curious how state management works with a
CoProcessFunction.