Dataflow SDK version: 2.4.0
I haven't tested with other attribute but when we use these attribute for de-duplication and timestaming we got null PubsubMessage's attribute
For example
PubsubIO.readMessages()
.fromSubscription("mine")
.withIdAttribute("id"))
.apply("name hehe", ParDo.of(new DoFn<PubsubMessage, String>() {
@ProcessElement
public void processElement(ProcessContext c) {
PubsubMessage message = c.element();
c.output(new String(message.getPayload(), Charset.forName("UTF-8"))
+ " id: " + message.getAttribute("id")); // id will be null here
}
}))
Dataflow SDK version: 2.4.0 I haven't tested with other attribute but when we use these attribute for de-duplication and timestaming we got null PubsubMessage's attribute For example
same with
.withTimestampAttribute(str)