streamnative / pulsar-spark

Spark Connector to read and write with Pulsar
Apache License 2.0
113 stars 50 forks source link

improve logging #153

Closed chaoqin-li1123 closed 1 year ago

chaoqin-li1123 commented 1 year ago

Motivation

GetBatch doesn't print offset range correctly because it is not a case class 2023-08-11T22:57:20.8908016Z stream execution thread for [id = 71ece58b-2fbe-4937-b4ef-d6bfa68aa396, runId = b6efacc4-df39-45b4-958c-e63e13698840]: GetBatch generating RDD of offset range: org.apache.spark.sql.pulsar.PulsarOffsetRange@53a7eb97

Modifications

Make offset range a case class so that it can be printed correctly.

Verifying this change

(Please pick either of the following options)

Documentation

Check the box below.

Need to update docs?