search

LynRodWS / alcor

Cloud native SDN platform powered by Kubernetes and Istio
MIT License
0 stars 0 forks source link

Update dependency org.apache.pulsar:pulsar-client-admin to v3 - autoclosed #337

Closed mend-for-github-com[bot] closed 8 months ago

mend-for-github-com[bot] commented 11 months ago

This PR contains the following updates:

Package Type Update Change
org.apache.pulsar:pulsar-client-admin compile major 2.6.1 -> 3.0.2

By merging this PR, the below issues will be automatically resolved and closed:

Severity CVSS Score CVE GitHub Issue
High 7.5 CVE-2021-35515 #155
High 7.5 CVE-2021-35516 #154
High 7.5 CVE-2021-35517 #153
High 7.5 CVE-2021-36090 #156
High 7.5 CVE-2023-39410 #312

Release Notes

apache/pulsar (org.apache.pulsar:pulsar-client-admin) ### [`v3.0.2`](https://togithub.com/apache/pulsar/releases/tag/v3.0.2) [Compare Source](https://togithub.com/apache/pulsar/compare/v3.0.1...v3.0.2) ##### Broker - \[fix]\[broker] Fix namespace bundle stuck in unloading status (21445) [#​21565](https://togithub.com/apache/pulsar/pull/21565) - \[fix]\[broker] Fix create topic with different auto creation strategies causes race condition [#​21545](https://togithub.com/apache/pulsar/pull/21545) - \[fix]\[broker] Fix thousands orphan PersistentTopic caused OOM [#​21540](https://togithub.com/apache/pulsar/pull/21540) - \[fix]\[broker] Fix failure while creating non-durable cursor with inactive managed-ledger [#​21508](https://togithub.com/apache/pulsar/pull/21508) - \[fix]\[broker] Fix PulsarService/BrokerService shutdown when brokerShutdownTimeoutMs=0 [#​21496](https://togithub.com/apache/pulsar/pull/21496) - \[fix]\[broker] Avoid pass null role in MultiRolesTokenAuthorizationProvider [#​21486](https://togithub.com/apache/pulsar/pull/21486) - \[fix]\[broker] Fix the deadlock when using BookieRackAffinityMapping with rackaware policy [#​21481](https://togithub.com/apache/pulsar/pull/21481) - \[fix]\[broker] Fix namespace bundle stuck in unloading status [#​21445](https://togithub.com/apache/pulsar/pull/21445) - \[fix]\[broker] Ignore individual acknowledgment for CompactorSubscription when an entry has been filtered. [#​21434](https://togithub.com/apache/pulsar/pull/21434) - \[fix]\[broker] Fix heartbeat namespace create event topic and cannot delete heartbeat topic [#​21360](https://togithub.com/apache/pulsar/pull/21360) - \[fix]\[broker] Fix heartbeat namespace create transaction internal topic [#​21348](https://togithub.com/apache/pulsar/pull/21348) - \[fix]\[broker] Fix unload operation stuck when use ExtensibleLoadManager [#​21332](https://togithub.com/apache/pulsar/pull/21332) - \[fix]\[broker]\[branch-3.0] Fix lookup heartbeat and sla namespace bundle when using extensible load manager (21213) [#​21313](https://togithub.com/apache/pulsar/pull/21313) - \[improve]\[broker] use ConcurrentHashMap in ServiceUnitStateChannel and avoid recursive update error [#​21282](https://togithub.com/apache/pulsar/pull/21282) - \[fix]\[broker]\[branch-3.0] Fix inconsistent topic policy [#​21256](https://togithub.com/apache/pulsar/pull/21256) - \[fix]\[broker]Fixed produce and consume when anonymousUserRole enabled [#​21237](https://togithub.com/apache/pulsar/pull/21237) - \[fix]\[broker] Fix inconsistent topic policy [#​21231](https://togithub.com/apache/pulsar/pull/21231) - \[fix]\[broker] Fixed reset for AggregatedNamespaceStats [#​21225](https://togithub.com/apache/pulsar/pull/21225) - \[fix]\[broker] Fix lookup heartbeat and sla namespace bundle when using extensible load manager [#​21213](https://togithub.com/apache/pulsar/pull/21213) - \[improve]\[broker] Not close the socket if lookup failed caused by bundle unloading or metadata ex [#​21211](https://togithub.com/apache/pulsar/pull/21211) - \[fix]\[broker] replicator leak when removeReplicator in NonPersistentTopic [#​21205](https://togithub.com/apache/pulsar/pull/21205) - \[improve] \[broker] Print warn log if ssl handshake error & print ledger id when switch ledger [#​21201](https://togithub.com/apache/pulsar/pull/21201) - \[fix]\[broker] Backport fix UniformLoadShedder selecet wrong overloadbroker and underloadbroker [#​21179](https://togithub.com/apache/pulsar/pull/21179) - \[improve] \[broker] improve read entry error log for troubleshooting [#​21169](https://togithub.com/apache/pulsar/pull/21169) - \[fix]\[broker]\[branch-3.0] Fix write duplicate entries into the compacted ledger after RawReader reconnects (21081) [#​21165](https://togithub.com/apache/pulsar/pull/21165) - \[improve]\[broker]\[branch-3.0] Make read compacted entries support maxReadSizeBytes limitation (21065) [#​21164](https://togithub.com/apache/pulsar/pull/21164) - \[fix]\[broker] Avoid splitting one batch message into two entries in StrategicTwoPhaseCompactor [#​21156](https://togithub.com/apache/pulsar/pull/21156) - \[fix]\[broker] Make specified producer could override the previous one [#​21155](https://togithub.com/apache/pulsar/pull/21155) - \[improve]\[broker] Upgrade bookkeeper to 4.16.3 [#​21146](https://togithub.com/apache/pulsar/pull/21146) - \[improve]\[broker] Improve logs for troubleshooting [#​21141](https://togithub.com/apache/pulsar/pull/21141) - \[fix]\[broker] Fix web tls url null cause NPE [#​21137](https://togithub.com/apache/pulsar/pull/21137) - \[fix]\[broker] Fix unack count when mixing non batch index and batch index acks [#​21126](https://togithub.com/apache/pulsar/pull/21126) - \[fix]\[broker] Fix unsubscribe non-durable subscription error [#​21099](https://togithub.com/apache/pulsar/pull/21099) - \[fix]\[broker] Fix isolated group not work problem. [#​21096](https://togithub.com/apache/pulsar/pull/21096) - \[fix]\[broker] Fix deleting topic not delete the related topic policy and schema. [#​21093](https://togithub.com/apache/pulsar/pull/21093) - \[fix]\[broker] Avoid splitting one batch message into two entries in StrategicTwoPhaseCompactor [#​21091](https://togithub.com/apache/pulsar/pull/21091) - \[fix]\[broker] revert remove duplicate topics name when deleteNamespace [#​21087](https://togithub.com/apache/pulsar/pull/21087) - \[fix]\[broker] Cleanup correctly heartbeat bundle ownership when handling broker deletion event [#​21083](https://togithub.com/apache/pulsar/pull/21083) - \[fix]\[broker] Fix write duplicate entries into the compacted ledger after RawReader reconnects [#​21081](https://togithub.com/apache/pulsar/pull/21081) - \[fix]\[broker] remove bundle-data in local metadata store. [#​21078](https://togithub.com/apache/pulsar/pull/21078) - \[fix]\[broker] Make sure all inflight writes have finished before completion of compaction [#​21067](https://togithub.com/apache/pulsar/pull/21067) - \[improve]\[broker] Make read compacted entries support maxReadSizeBytes limitation [#​21065](https://togithub.com/apache/pulsar/pull/21065) - \[improve]\[broker] Improve cache handling for partitioned topic metadata when doing lookup [#​21063](https://togithub.com/apache/pulsar/pull/21063) - \[fix]\[broker] Use MessageDigest.isEqual when comparing digests [#​21061](https://togithub.com/apache/pulsar/pull/21061) - \[fix]\[broker] Fix potential case cause retention policy not working on topic level [#​21041](https://togithub.com/apache/pulsar/pull/21041) - \[fix]\[broker] fix UniformLoadShedder selecet wrong overloadbroker and underloadbroker [#​21025](https://togithub.com/apache/pulsar/pull/21025) - \[fix]\[broker] Fix incorrect unack msk count when dup ack a message [#​20990](https://togithub.com/apache/pulsar/pull/20990) - \[fix]\[broker] Fix can't stop phase-two of compaction even though messageId read reaches lastReadId [#​20988](https://togithub.com/apache/pulsar/pull/20988) - \[fix]\[broker] Fix compaction subscription delete by inactive subscription check. [#​20983](https://togithub.com/apache/pulsar/pull/20983) - \[fix]\[broker] Fix message loss during topic compaction [#​20980](https://togithub.com/apache/pulsar/pull/20980) - \[fix]\[broker] Fix incorrect number of read compacted entries [#​20978](https://togithub.com/apache/pulsar/pull/20978) - \[fix]\[broker] Producer is blocked on creation because backlog exceeded on topic, when dedup is enabled and no producer is there [#​20951](https://togithub.com/apache/pulsar/pull/20951) - \[fix]\[broker]Fix chunked messages will be filtered by duplicating [#​20948](https://togithub.com/apache/pulsar/pull/20948) - \[fix]\[broker] rackaware policy is ineffective when delete zk rack info after bkclient initialize [#​20944](https://togithub.com/apache/pulsar/pull/20944) - \[fix]\[broker]Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin [#​20939](https://togithub.com/apache/pulsar/pull/20939) - \[fix]\[broker] fix MessageDeduplication throw NPE when enable broker dedup and set namespace disable deduplication. [#​20905](https://togithub.com/apache/pulsar/pull/20905) - \[fix]\[broker] In replication scenario, remote consumer could not be registered if there has no message was sent [#​20888](https://togithub.com/apache/pulsar/pull/20888) - \[fix]\[broker] Fix inconsensus namespace policies by `getPoliciesIfCached` [#​20855](https://togithub.com/apache/pulsar/pull/20855) - \[improve]\[broker] Avoid print redirect exception log when get list from bundle [#​20846](https://togithub.com/apache/pulsar/pull/20846) - \[fix]\[broker] Inconsistent behaviour for topic auto_creation [#​20843](https://togithub.com/apache/pulsar/pull/20843) - \[fix]\[broker] Can not receive any messages after switch to standby cluster [#​20767](https://togithub.com/apache/pulsar/pull/20767) - \[fix]\[broker] Fix get topic policies as null during clean cache [#​20763](https://togithub.com/apache/pulsar/pull/20763) - \[fix]\[broker] Avoid throwing RestException in BrokerService [#​20761](https://togithub.com/apache/pulsar/pull/20761) - \[fix]\[broker] Gracefully shutdown does not work with admin cli in standalone [#​20709](https://togithub.com/apache/pulsar/pull/20709) - \[fix]\[broker] Fix ModularLoadManagerImpl always delete active bundle-data. sec ver. [#​20620](https://togithub.com/apache/pulsar/pull/20620) - \[improve]\[broker] Add consumer-id into the log when doing subscribe. [#​20568](https://togithub.com/apache/pulsar/pull/20568) - \[fix]\[broker] consider iowait as idle. [#​19110](https://togithub.com/apache/pulsar/pull/19110) - \[fix]\[broker] fix bug caused by optimistic locking [#​18390](https://togithub.com/apache/pulsar/pull/18390) - \[fix]\[ml] Fix orphan scheduled task for ledger create timeout check [#​21542](https://togithub.com/apache/pulsar/pull/21542) - \[fix]\[ml] Fix unfinished callback when deleting managed ledger [#​21530](https://togithub.com/apache/pulsar/pull/21530) - \[fix]\[ml] fix discontinuous ledger deletion [#​20898](https://togithub.com/apache/pulsar/pull/20898) - \[fix]\[ml] Fix thread safe issue with RangeCache.put and RangeCache.clear [#​21302](https://togithub.com/apache/pulsar/pull/21302) - \[fix]\[ml] fix wrong msg backlog of non-durable cursor after trim ledgers [#​21250](https://togithub.com/apache/pulsar/pull/21250) - \[fix]\[ml] Reader can set read-pos to a deleted ledger [#​21248](https://togithub.com/apache/pulsar/pull/21248) - \[improve]\[ml] Persist mark deleted ops to ZK if create cursor ledger was failed [#​20935](https://togithub.com/apache/pulsar/pull/20935) - \[fix]\[txn] OpRequestSend reuse problem cause tbClient commitTxnOnTopic timeout unexpectedly [#​21505](https://togithub.com/apache/pulsar/pull/21505) #### Clients - \[fix]\[client] Fix print error log 'Auto getting partitions failed' when expend partition. [#​21485](https://togithub.com/apache/pulsar/pull/21485) - \[fix]\[client] fix reader.hasMessageAvailable return false when incoming queue is not empty [#​21259](https://togithub.com/apache/pulsar/pull/21259) - \[improve]\[client] Merge lookup requests for the same topic [#​21232](https://togithub.com/apache/pulsar/pull/21232) - \[fix]\[client] fix same producer/consumer use more than one connection per broker [#​21144](https://togithub.com/apache/pulsar/pull/21144) - \[fix]\[client] Fix repeat consume when using n-ack and batched messages [#​21116](https://togithub.com/apache/pulsar/pull/21116) - \[fix]\[client] Avoid ack hole for chunk message [#​21101](https://togithub.com/apache/pulsar/pull/21101) - \[fix]\[client] Fix logging problem in pulsar client [#​21094](https://togithub.com/apache/pulsar/pull/21094) - \[fix]\[client] Fix consumer can't consume resent chunked messages [#​21070](https://togithub.com/apache/pulsar/pull/21070) - \[fix]\[client] Fix cannot retry chunk messages and send to DLQ [#​21048](https://togithub.com/apache/pulsar/pull/21048) - \[fix]\[client] Fix RawReader hasMessageAvailable returns true when no messages [#​21032](https://togithub.com/apache/pulsar/pull/21032) - \[fix]\[client] Fix perf-producer get OOM with high publish latency [#​20914](https://togithub.com/apache/pulsar/pull/20914) - \[improve]\[client] Disable polling pattern topics when TopicListWatcher is enabled. [#​20779](https://togithub.com/apache/pulsar/pull/20779) - \[fix]\[client] Fix subscribing pattern topics through Proxy not working [#​20739](https://togithub.com/apache/pulsar/pull/20739) - \[fix]\[client] Messages lost when consumer reconnect [#​20695](https://togithub.com/apache/pulsar/pull/20695) - \[fix]\[txn] fix the consumer stuck due to deduplicated messages in pending ack state [#​21177](https://togithub.com/apache/pulsar/pull/21177) ##### Pulsar IO and Pulsar Functions - \[fix]\[fn] fix functions_log4j2.xml delete strategy config [#​21215](https://togithub.com/apache/pulsar/pull/21215) - \[fix]\[fn] Fix ProducerConfig cannot update error [#​21037](https://togithub.com/apache/pulsar/pull/21037) - \[fix]\[fn] Fix the --batch-builder not working error for functions [#​21023](https://togithub.com/apache/pulsar/pull/21023) - \[fix]\[io] Fix --retain\[-key]-ordering not working error for sink [#​21060](https://togithub.com/apache/pulsar/pull/21060) - \[fix]\[io] Update test certs for Elasticsearch [#​21001](https://togithub.com/apache/pulsar/pull/21001) - \[fix]\[io]\[branch-3.0] Not restart instance when kafka source poll exception. [#​20818](https://togithub.com/apache/pulsar/pull/20818) - \[fix]\[io] elastic-search sink connector not support JSON.String schema. [#​20741](https://togithub.com/apache/pulsar/pull/20741) - \[feat]\[sql] Support UUID for json and avro [#​21267](https://togithub.com/apache/pulsar/pull/21267) - \[improve]\[sql] Fix the wrong format of the logs [#​20907](https://togithub.com/apache/pulsar/pull/20907) ##### Observability ##### CLI - \[fix]\[admin] Fix get topic stats fail if a subscription catch up concurrently [#​20971](https://togithub.com/apache/pulsar/pull/20971) ##### Others - \[fix]\[bk-client] Fix bk client MinNumRacksPerWriteQuorum and EnforceMinNumRacksPerWriteQuorum not work problem. [#​21327](https://togithub.com/apache/pulsar/pull/21327) - \[fix]\[build] Fix apt download issue in building the docker image [#​21489](https://togithub.com/apache/pulsar/pull/21489) - \[fix]\[build]\[branch-3.0] Fix in-correct license definetion [#​21435](https://togithub.com/apache/pulsar/pull/21435) - \[fix]\[test]\[branch-3.0] Fix AutoRecovery flaky test. [#​21418](https://togithub.com/apache/pulsar/pull/21418) - \[fix]\[test] Fix LocalBookkeeperEnsemble resource leak in tests [#​21407](https://togithub.com/apache/pulsar/pull/21407) - \[improve]\[ci] Add new CI unit test group "Broker Group 4" with cluster migration tests [#​21391](https://togithub.com/apache/pulsar/pull/21391) - \[fix]\[test] Fix a resource leak in ClusterMigrationTest [#​21366](https://togithub.com/apache/pulsar/pull/21366) - \[fix]\[ci] Fix docker image building by releasing more disk space before building [#​21365](https://togithub.com/apache/pulsar/pull/21365) - \[fix]\[sec] Fix MultiRoles token provider when using anonymous clients [#​21338](https://togithub.com/apache/pulsar/pull/21338) - \[fix]\[test] Fix flaky test NarUnpackerTest [#​21328](https://togithub.com/apache/pulsar/pull/21328) - \[fix]\[auto-recovery]\[branch-3.0] Fix PulsarLedgerUnderreplicationManager notify problem. [#​21312](https://togithub.com/apache/pulsar/pull/21312) - \[fix]\[metadata] Fix zookeeper related flacky test [#​21310](https://togithub.com/apache/pulsar/pull/21310) - \[fix]\[sec] Add OWASP Dependency Check suppressions [#​21281](https://togithub.com/apache/pulsar/pull/21281) - \[improve]\[proxy] Not close the socket if lookup failed caused by too many requests [#​21216](https://togithub.com/apache/pulsar/pull/21216) - \[improve]\[auto-recovery] Migrate the replication testing from BookKeeper to Pulsar. [#​21188](https://togithub.com/apache/pulsar/pull/21188) - \[fix]\[auto-recovery] Fix pulsar ledger auditor dead lock problem. [#​21181](https://togithub.com/apache/pulsar/pull/21181) - \[fix]\[auto-recovery] Fix PulsarLedgerUnderreplicationManager notify problem. [#​21161](https://togithub.com/apache/pulsar/pull/21161) - \[fix]\[bk] Improve to the ReplicaitonWorker performance by deleting invalid underreplication nodes [#​21160](https://togithub.com/apache/pulsar/pull/21160) - \[fix]\[auto-recovery] Fix metadata store deadlock due to BookkeeperInternalCallbacks.Processor [#​21159](https://togithub.com/apache/pulsar/pull/21159) - \[fix]\[bookie] Fix RocksDB configuration [#​21157](https://togithub.com/apache/pulsar/pull/21157) - \[fix]\[proxy] Fix Proxy 502 gateway error when it is configured with Keystore TLS and admin API is called [#​21077](https://togithub.com/apache/pulsar/pull/21077) - \[fix]\[auto-recovery] Improve to the ReplicaitonWorker performance by deleting invalid underreplication nodes [#​21059](https://togithub.com/apache/pulsar/pull/21059) - \[fix]\[bk] Correctct the bookie info after ZK client is reconnected [#​21035](https://togithub.com/apache/pulsar/pull/21035) - \[improve]\[proxy] Support disabling metrics endpoint [#​21031](https://togithub.com/apache/pulsar/pull/21031) - \[fix]\[meta] Fix deadlock in AutoRecovery. [#​21010](https://togithub.com/apache/pulsar/pull/21010) - \[improve]\[ws] add cryptoKeyReaderFactoryClassName into the file websocket.conf [#​20840](https://togithub.com/apache/pulsar/pull/20840) - \[improve]\[offload] Extend the offload policies to allow specifying more conf [#​20804](https://togithub.com/apache/pulsar/pull/20804) - \[improve]\[offload] Create offload resources lazily [#​20775](https://togithub.com/apache/pulsar/pull/20775) - \[improve]\[offload] Support to configure more offload driver [#​20736](https://togithub.com/apache/pulsar/pull/20736) - \[fix]\[test] Close the resource after the test [#​20778](https://togithub.com/apache/pulsar/pull/20778) - \[fix]\[schema] Only handle exception when there has [#​20730](https://togithub.com/apache/pulsar/pull/20730) - \[improve]\[admin] Remove duplicate topics name when `deleteNamespace` [#​20683](https://togithub.com/apache/pulsar/pull/20683) - \[fix]\[txn] fix consumer can receive aborted txn message when readType is replay [#​19815](https://togithub.com/apache/pulsar/pull/19815) ##### Library updates - Upgrade Zookeeper to 3.8.3 to address CVE-2023-44981 [#​21398](https://togithub.com/apache/pulsar/pull/21398) - Upgrade Netty to 4.1.100 to address CVE-2023-44487 [#​21397](https://togithub.com/apache/pulsar/pull/21397) - Upgrade Jetty to 9.4.53 to address CVE-2023-44487 [#​21395](https://togithub.com/apache/pulsar/pull/21395) - Upgrade Guava to 32.1.1 to address CVE-2023-2976 [#​20699](https://togithub.com/apache/pulsar/pull/20699) - Upgrade Netty to 4.1.94.Final to address CVE-2023-34462 [#​20632](https://togithub.com/apache/pulsar/pull/20632) - Upgrade to jetcd to 0.7.5 [#​20339](https://togithub.com/apache/pulsar/pull/20339) - Upgrade Lombok to 1.18.30 to support compiling with JDK21 [#​21278](https://togithub.com/apache/pulsar/pull/21278) - Bump avro version to 1.11.3 for CVE-2023-39410 [#​21341](https://togithub.com/apache/pulsar/pull/21341) - Bump GRPC version to 1.55.3 to fix CVE [#​21057](https://togithub.com/apache/pulsar/pull/21057) - Bump broker okio version to 3.4.0 [#​21064](https://togithub.com/apache/pulsar/pull/21064) For the complete list, check the [Pulsar 3.0.2 changelog](https://togithub.com/apache/pulsar/pulls?q=is%3Apr+label%3Arelease%2F3.0.2+). ### [`v3.0.1`](https://togithub.com/apache/pulsar/releases/tag/v3.0.1) [Compare Source](https://togithub.com/apache/pulsar/compare/v3.0.0...v3.0.1) ##### Important notice - Fix the reason label of authentication metrics in [#​20030](https://togithub.com/apache/pulsar/pull/20030) ##### Broker - \[Broker] Add annotation for topic compaction strategy by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20858](https://togithub.com/apache/pulsar/pull/20858) - \[Broker] Add broker filter sync method back to guarantee the API compatibility by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20826](https://togithub.com/apache/pulsar/pull/20826) - \[Broker] Avoid infinite bundle unloading by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20822](https://togithub.com/apache/pulsar/pull/20822) - \[Broker] Call ServerCnx#closeProducer from correct thread by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20747](https://togithub.com/apache/pulsar/pull/20747) - \[Broker] Added the skipped message handler for ServiceUnitStateChannel by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​20677](https://togithub.com/apache/pulsar/pull/20677) - \[Broker] Make ExtensibleLoadManagerImpl's broker filter pure async by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20666](https://togithub.com/apache/pulsar/pull/20666) - \[Broker] Fix the publish latency spike from the contention of MessageDeduplication by [@​codelipenghui](https://togithub.com/codelipenghui) in [#​20647](https://togithub.com/apache/pulsar/pull/20647) - \[Broker] Fix get owned service units NPE by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20625](https://togithub.com/apache/pulsar/pull/20625) - \[Broker] Topic policy can not work well if replay policy message has any exception. by [@​zhanghaou](https://togithub.com/zhanghaou) in [#​20613](https://togithub.com/apache/pulsar/pull/20613) - \[Broker] Fix the publish latency spike issue with a large number of producers by [@​codelipenghui](https://togithub.com/codelipenghui) in [#​20607](https://togithub.com/apache/pulsar/pull/20607) - \[Broker] New load balancer system topic should not be auto-created now by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​20566](https://togithub.com/apache/pulsar/pull/20566) - \[Broker] Handle get owned namespaces admin API in ExtensibleLoadManager by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20552](https://togithub.com/apache/pulsar/pull/20552) - \[Broker] Handle heartbeat namespace in ExtensibleLoadManager by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20551](https://togithub.com/apache/pulsar/pull/20551) - \[Broker] Validate authz earlier in delete subscription logic by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20549](https://togithub.com/apache/pulsar/pull/20549) - \[Broker] REST Client Producer fails with TLS only by [@​maanders-tibco](https://togithub.com/maanders-tibco) in [#​20535](https://togithub.com/apache/pulsar/pull/20535) - \[Broker] Fix redirect loop when using ExtensibleLoadManager and list in bundle admin API by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20528](https://togithub.com/apache/pulsar/pull/20528) - \[Broker] Restore solution for certain topic unloading race conditions by [@​lhotari](https://togithub.com/lhotari) in [#​20527](https://togithub.com/apache/pulsar/pull/20527) - \[Broker] Emit the namespace bundle listener event on extensible load manager by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20525](https://togithub.com/apache/pulsar/pull/20525) - \[Broker] Disable EntryFilters for system topics by [@​lhotari](https://togithub.com/lhotari) in [#​20514](https://togithub.com/apache/pulsar/pull/20514) - \[Broker] Replace test call to Auth0 with call to WireMock by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20465](https://togithub.com/apache/pulsar/pull/20465) - \[Broker] Fix return the earliest position when query position by timestamp. by [@​hanmz](https://togithub.com/hanmz) in [#​20457](https://togithub.com/apache/pulsar/pull/20457) - \[Broker] Avoid `PersistentSubscription.expireMessages` logic check backlog twice. by [@​lifepuzzlefun](https://togithub.com/lifepuzzlefun) in [#​20416](https://togithub.com/apache/pulsar/pull/20416) - \[Broker] PIP-255 Part-1: Add listener interface for namespace service by [@​hleecs](https://togithub.com/hleecs) in [#​20406](https://togithub.com/apache/pulsar/pull/20406) - \[Broker] Partitioned \__change_events topic is policy topic by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20392](https://togithub.com/apache/pulsar/pull/20392) - \[Broker] Do not expose bucketDelayedIndexStats by [@​coderzc](https://togithub.com/coderzc) in [#​20383](https://togithub.com/apache/pulsar/pull/20383) - \[Broker] Pre-create non-partitioned system topics for load balance extension by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​20370](https://togithub.com/apache/pulsar/pull/20370) - \[Broker] ManagedLedger.getConfig().getProperties().putAll(properties) NPE by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​20361](https://togithub.com/apache/pulsar/pull/20361) - \[Broker] Fix broker load manager class filter NPE by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20350](https://togithub.com/apache/pulsar/pull/20350) - \[Broker] In Key_Shared mode: remove unnecessary mechanisms of message skip to avoid unnecessary consumption stuck by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​20335](https://togithub.com/apache/pulsar/pull/20335) - \[Broker] When creating a namespace anti-affinity group with the default local policies, use the bundle size supplied by the user. by [@​syk-coder](https://togithub.com/syk-coder) in [#​20327](https://togithub.com/apache/pulsar/pull/20327) - \[Broker] Fix skip message API when hole messages exist by [@​crossoverJie](https://togithub.com/crossoverJie) in [#​20326](https://togithub.com/apache/pulsar/pull/20326) - \[Broker] Gracefully shut download balancer extension by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​20315](https://togithub.com/apache/pulsar/pull/20315) - \[Broker] Fix class name typo `PrecisPublishLimiter` to "Precise" by [@​JooHyukKim](https://togithub.com/JooHyukKim) in [#​20310](https://togithub.com/apache/pulsar/pull/20310) - \[Broker] Allow Access to System Topic Metadata for Reader Creation Post-Namespace Deletion by [@​liangyepianzhou](https://togithub.com/liangyepianzhou) in [#​20304](https://togithub.com/apache/pulsar/pull/20304) - \[Broker] Fix NPE caused by topic publish rate limiter. by [@​dragonls](https://togithub.com/dragonls) in [#​20302](https://togithub.com/apache/pulsar/pull/20302) - \[Broker] Fix `UnsupportedOperationException` when updating topic properties. by [@​liangyepianzhou](https://togithub.com/liangyepianzhou) in [#​20261](https://togithub.com/apache/pulsar/pull/20261) - \[Broker] Fix ledger cachemiss size metric by [@​AnonHxy](https://togithub.com/AnonHxy) in [#​20257](https://togithub.com/apache/pulsar/pull/20257) - \[Broker] Fix default bundle size used while setting bookie affinity by [@​syk-coder](https://togithub.com/syk-coder) in [#​20250](https://togithub.com/apache/pulsar/pull/20250) - \[Broker] Fix the behavior of delayed message in Key_Shared mode by [@​codelipenghui](https://togithub.com/codelipenghui) in [#​20233](https://togithub.com/apache/pulsar/pull/20233) - \[Broker] Fix Return value of getPartitionedStats doesn't contain subscription type by [@​1Jack2](https://togithub.com/1Jack2) in [#​20210](https://togithub.com/apache/pulsar/pull/20210) - \[Broker] Skip split bundle if only one broker by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​20190](https://togithub.com/apache/pulsar/pull/20190) - \[Broker] Fix `RoaringBitmap.contains` can't check value 65535 by [@​coderzc](https://togithub.com/coderzc) in [#​20176](https://togithub.com/apache/pulsar/pull/20176) - \[Broker] Release EntryBuffer after parsing proto object by [@​coderzc](https://togithub.com/coderzc) in [#​20170](https://togithub.com/apache/pulsar/pull/20170) - \[Broker] Remove useless field in the DelayedMessageIndexBucketSegment.proto by [@​coderzc](https://togithub.com/coderzc) in [#​20166](https://togithub.com/apache/pulsar/pull/20166) - \[Broker] Optimization protobuf code in the bucket delayed tracker by [@​coderzc](https://togithub.com/coderzc) in [#​20158](https://togithub.com/apache/pulsar/pull/20158) - \[Broker] Move bitmap from lastMutableBucket to ImmutableBucket by [@​coderzc](https://togithub.com/coderzc) in [#​20156](https://togithub.com/apache/pulsar/pull/20156) - \[Broker] Fix tenant admin authorization bug. ([#​20068](https://togithub.com/apache/pulsar/issues/20068))" by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20143](https://togithub.com/apache/pulsar/pull/20143) - \[Broker] Producer/Consumer should call allowTopicOperationAsync by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20142](https://togithub.com/apache/pulsar/pull/20142) - \[Broker] Fix entry filter feature for the non-persistent topic by [@​gaoran10](https://togithub.com/gaoran10) in [#​20141](https://togithub.com/apache/pulsar/pull/20141) - \[Broker] Optimize delayed metadata index bitmap by [@​mattisonchao](https://togithub.com/mattisonchao) in [#​20136](https://togithub.com/apache/pulsar/pull/20136) - \[Broker] Fast fix infinite HTTP call getSubscriptions caused by wrong topicName by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​20131](https://togithub.com/apache/pulsar/pull/20131) - \[Broker] Make timer execute immediately after load index by [@​coderzc](https://togithub.com/coderzc) in [#​20126](https://togithub.com/apache/pulsar/pull/20126) - \[Broker] Cache LedgerHandle in BookkeeperBucketSnapshotStorage by [@​coderzc](https://togithub.com/coderzc) in [#​20117](https://togithub.com/apache/pulsar/pull/20117) - \[Broker] Close temporary open ledger in BookkeeperBucketSnapshotStorage by [@​lifepuzzlefun](https://togithub.com/lifepuzzlefun) in [#​20111](https://togithub.com/apache/pulsar/pull/20111) - \[Broker] Fix use error TimeUnit to record publish latency by [@​TakaHiR07](https://togithub.com/TakaHiR07) in [#​20074](https://togithub.com/apache/pulsar/pull/20074) - \[Broker] Fix tenant admin authorization bug. by [@​dragonls](https://togithub.com/dragonls) in [#​20068](https://togithub.com/apache/pulsar/pull/20068) - \[Broker] Fix getPartitionedStats miss subscription's messageAckRate by [@​wangjialing218](https://togithub.com/wangjialing218) in [#​19870](https://togithub.com/apache/pulsar/pull/19870) - \[Broker] Do not filter system topic while shedding. by [@​thetumbled](https://togithub.com/thetumbled) in [#​18949](https://togithub.com/apache/pulsar/pull/18949) - \[Broker] There are two same-named managed ledgers in the one broker by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​18688](https://togithub.com/apache/pulsar/pull/18688) - \[Broker] If ledger lost, cursor mark delete position can not forward by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​18620](https://togithub.com/apache/pulsar/pull/18620) - \[Broker] Support cgroup v2 by using `jdk.internal.platform.Metrics` in Pulsar Loadbalancer by [@​coderzc](https://togithub.com/coderzc) in [#​16832](https://togithub.com/apache/pulsar/pull/16832) #### Clients - \[Client] Fix the deadlock issue of consumers while using multiple IO threads by [@​codelipenghui](https://togithub.com/codelipenghui) in [#​20669](https://togithub.com/apache/pulsar/pull/20669) - \[Client] Make the whole grabCnx() progress atomic by [@​BewareMyPower](https://togithub.com/BewareMyPower) in [#​20595](https://togithub.com/apache/pulsar/pull/20595) - \[Client] Thread-safe seek by [@​tisonkun](https://togithub.com/tisonkun) in [#​20321](https://togithub.com/apache/pulsar/pull/20321) - \[Client] Fix where the function getMsgNumInReceiverQueue always returns 0 when using message listener by [@​crossoverJie](https://togithub.com/crossoverJie) in [#​20245](https://togithub.com/apache/pulsar/pull/20245) - \[Client] Java Client's Seek Logic Not Threadsafe [#​1](https://togithub.com/apache/pulsar/issues/1) by [@​JooHyukKim](https://togithub.com/JooHyukKim) in [#​20242](https://togithub.com/apache/pulsar/pull/20242) ##### Pulsar IO and Pulsar Functions - \[Functions] Exit JVM when the main thread throws an exception by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20689](https://togithub.com/apache/pulsar/pull/20689) - \[Functions] TLS args admin download command use zero arity by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20513](https://togithub.com/apache/pulsar/pull/20513) - \[Functions] Support customizing TLS config for function download command by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20482](https://togithub.com/apache/pulsar/pull/20482) - \[Functions] Reset idle timer correctly by [@​flowchartsman](https://togithub.com/flowchartsman) in [#​20450](https://togithub.com/apache/pulsar/pull/20450) - \[Functions] Go functions must retrieve consumers by non-partitioned topic ID by [@​flowchartsman](https://togithub.com/flowchartsman) in [#​20413](https://togithub.com/apache/pulsar/pull/20413) - \[Functions] Go functions need to use static grpcPort in k8s runtime by [@​flowchartsman](https://togithub.com/flowchartsman) in [#​20404](https://togithub.com/apache/pulsar/pull/20404) - \[Functions] Correct TLS cert config translation from broker to fn worker by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20297](https://togithub.com/apache/pulsar/pull/20297) - \[Functions] Use functions classloader in TopicSchema.newSchemaInstance() to fix ClassNotFoundException when using custom SerDe classes. (targeted for master) by [@​gmiklos-ltg](https://togithub.com/gmiklos-ltg) in [#​20115](https://togithub.com/apache/pulsar/pull/20115) - \[Functions] Check user metric len before iterating by [@​flowchartsman](https://togithub.com/flowchartsman) in [#​20021](https://togithub.com/apache/pulsar/pull/20021) - \[Functions] Support multiple input topics for Go runtime by [@​jiangpengcheng](https://togithub.com/jiangpengcheng) in [#​20000](https://togithub.com/apache/pulsar/pull/20000) - \[Functions] Make pulsar-admin support update py/go with package url by [@​jiangpengcheng](https://togithub.com/jiangpengcheng) in [#​19897](https://togithub.com/apache/pulsar/pull/19897) - \[Functions] Fix JavaInstanceStarter inferring type class name error by [@​jiangpengcheng](https://togithub.com/jiangpengcheng) in [#​19896](https://togithub.com/apache/pulsar/pull/19896) - \[Functions] Fix function update error by [@​jiangpengcheng](https://togithub.com/jiangpengcheng) in [#​19895](https://togithub.com/apache/pulsar/pull/19895) - \[Functions] Make KubernetesRuntime translate characters in function tenant, namespace, and name during function removal to avoid label errors by [@​csthomas1](https://togithub.com/csthomas1) in [#​19584](https://togithub.com/apache/pulsar/pull/19584) - \[Connectors] Close the Kafka source connector that got stuck by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​20698](https://togithub.com/apache/pulsar/pull/20698) - \[Connectors] Close the Kafka source connector if there is an uncaught exception by [@​RobertIndie](https://togithub.com/RobertIndie) in [#​20424](https://togithub.com/apache/pulsar/pull/20424) - \[Connectors] Add protobuf ByteString to pulsar-io jdbc core by [@​bpereto](https://togithub.com/bpereto) in [#​20259](https://togithub.com/apache/pulsar/pull/20259) - \[Connectors] KCA: handle kafka sources that use commitRecord by [@​dlg99](https://togithub.com/dlg99) in [#​20121](https://togithub.com/apache/pulsar/pull/20121) ##### Observability - \[Metrics] Add JVM start time metric by [@​Technoboy-](https://togithub.com/Technoboy-) in [#​20381](https://togithub.com/apache/pulsar/pull/20381) - \[Metrics] Fix the reason label of authentication metrics by [@​gaoran10](https://togithub.com/gaoran10) in [#​20030](https://togithub.com/apache/pulsar/pull/20030) ##### CLI - \[Pulsar Admin] Set ns level backlog quota does not take effect if retention exists by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​20690](https://togithub.com/apache/pulsar/pull/20690) - \[Pulsar Admin] Make get list from bundle Admin API async by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​20652](https://togithub.com/apache/pulsar/pull/20652) - \[Pulsar Admin] Return BAD_REQUEST on cluster data is null for createCluster by [@​tisonkun](https://togithub.com/tisonkun) in [#​20346](https://togithub.com/apache/pulsar/pull/20346) - \[Pulsar Admin] Fix examine messages if total message is zero by [@​AnonHxy](https://togithub.com/AnonHxy) in [#​20152](https://togithub.com/apache/pulsar/pull/20152) - \[Pulsar Admin] Fast fix infinite HTTP call getSubscriptions caused by wrong topicName by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​20131](https://togithub.com/apache/pulsar/pull/20131) - \[Pulsar Admin] Report earliest msg in partitioned backlog by [@​teabot](https://togithub.com/teabot) in [#​19465](https://togithub.com/apache/pulsar/pull/19465) - \[Pulsar CLI] The variable producerName of BatchMsgContainer is null by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​20819](https://togithub.com/apache/pulsar/pull/20819) - \[Pulsar CLI] Allow pulser-client consume to create a replicated subscription by [@​JooHyukKim](https://togithub.com/JooHyukKim) in [#​20316](https://togithub.com/apache/pulsar/pull/20316) - \[Pulsar CLI] Fix logging noise while admin tool exit by [@​rdhabalia](https://togithub.com/rdhabalia) in [#​19884](https://togithub.com/apache/pulsar/pull/19884) - \[Client Tool] PerformanceProducer does not produce the expected number of messages. by [@​thetumbled](https://togithub.com/thetumbled) in [#​19775](https://togithub.com/apache/pulsar/pull/19775) ##### Others - \[Schema] Add admin CLI for testCompatibility by [@​congbobo184](https://togithub.com/congbobo184) in [#​19974](https://togithub.com/apache/pulsar/pull/19974) ##### Library updates - Upgrade PyYaml version to 6.0.1 by [@​yaalsn](https://togithub.com/yaalsn) in [#​20831](https://togithub.com/apache/pulsar/pull/20831) - Upgrade bookkeeper to 4.16.2 by [@​zymap](https://togithub.com/zymap) in [#​20704](https://togithub.com/apache/pulsar/pull/20704) - Upgrade snappy-java to address multiple CVEs by [@​lhotari](https://togithub.com/lhotari) in [#​20604](https://togithub.com/apache/pulsar/pull/20604) - Upgrade Jetty to address CVEs by [@​lhotari](https://togithub.com/lhotari) in [#​20461](https://togithub.com/apache/pulsar/pull/20461) - Upgrade maven surefire plugin and other build/test plugins/libs including TestNG version by [@​lhotari](https://togithub.com/lhotari) in [#​20270](https://togithub.com/apache/pulsar/pull/20270) - Upgrade Netty to 4.1.93.Final by [@​lhotari](https://togithub.com/lhotari) in [#​20423](https://togithub.com/apache/pulsar/pull/20423) - Upgrade sqlite-jdbc to resolve CVE-2023-32697 by [@​lhotari](https://togithub.com/lhotari) in [#​20411](https://togithub.com/apache/pulsar/pull/20411) - Upgrade Guava to 32.0.0 to address CVE-2023-2976 by [@​lhotari](https://togithub.com/lhotari) in [#​20459](https://togithub.com/apache/pulsar/pull/20459) For the complete list, check the [Pulsar 3.0.1 changelog](https://togithub.com/apache/pulsar/pulls?q=is%3Apr+label%3Arelease%2F3.0.1+). ### [`v3.0.0`](https://togithub.com/apache/pulsar/releases/tag/v3.0.0) [Compare Source](https://togithub.com/apache/pulsar/compare/v2.11.4...v3.0.0) ##### Important notice - Upgrade the RocksDB version to 7.9.2 to keep sync with BookKeeper's RocksDB dependency in [#​20072](https://togithub.com/apache/pulsar/pull/20072) - Introduce consistent hash ring to distribute the load of multiple topics subscription in [#​19502](https://togithub.com/apache/pulsar/pull/19502) - Remove default 30s ackTimeout when setting DLQ policy on java consumer in [#​19486](https://togithub.com/apache/pulsar/pull/19486) - Require authRole is proxyRole to set originalPrincipal in [#​19455](https://togithub.com/apache/pulsar/pull/19455) - Update Elasticsearch sink idle cnx timeout to 30s in [#​19377](https://togithub.com/apache/pulsar/pull/19377) - Move checked exception into builder when newTransaction. in [#​19356](https://togithub.com/apache/pulsar/pull/19356) - TokenAuthenticationState: authenticate token only once in [#​19314](https://togithub.com/apache/pulsar/pull/19314) - OneStageAuth State: move authn out of constructor in [#​19295](https://togithub.com/apache/pulsar/pull/19295) - Update AuthenticationProvider to simplify HTTP Authn in [#​19197](https://togithub.com/apache/pulsar/pull/19197) - Remove AuthorizationProvider methods deprecated in 2.7 and 2.9 in [#​19182](https://togithub.com/apache/pulsar/pull/19182) - Deprecate blocking AuthorizationService, AuthorizationProvider methods in [#​19180](https://togithub.com/apache/pulsar/pull/19180) - Reject create non existent persistent partitions. in [#​19086](https://togithub.com/apache/pulsar/pull/19086) - Omit making a copy of CommandAck when there are no broker interceptors in [#​18997](https://togithub.com/apache/pulsar/pull/18997) - Use correct file path for tls trust certificates in [#​18712](https://togithub.com/apache/pulsar/pull/18712) - Enable certificate refresh for Quorum and Netty Servers in [#​18097](https://togithub.com/apache/pulsar/pull/18097) - Remove timestamp from Prometheus metrics in [#​17419](https://togithub.com/apache/pulsar/pull/17419) - Revert 5895: fix redeliveryCount in [#​17060](https://togithub.com/apache/pulsar/pull/17060) - Fix producer/consume permission can’t get v1/schema in [#​16018](https://togithub.com/apache/pulsar/pull/16018) - Autorecovery default reppDnsResolverClass to ZkBookieRackAffinityMapping in [#​15640](https://togithub.com/apache/pulsar/pull/15640) - Allow to build and push multi-arch Docker images in [#​19432](https://togithub.com/apache/pulsar/pull/19432) ##### PIPs - PIP-160 Metrics stats of Transaction buffered writer [#​15370](https://togithub.com/apache/pulsar/issues/15370) - PIP-167 Make it Configurable to Require Subscription Permission [#​15576](https://togithub.com/apache/pulsar/pull/15576) - PIP-169 Support split bundle by flow or qps [#​16782](https://togithub.com/apache/pulsar/pull/16782) - PIP-188: Cluster migration or Blue-Green cluster deployment support in Pulsar [#​16551](https://togithub.com/apache/pulsar/pull/16551) - PIP-192: New Pulsar Broker Load Balancer [#​16691](https://togithub.com/apache/pulsar/pull/16691) - PIP-214: Add broker level metrics statistics and expose to prometheus [#​18056](https://togithub.com/apache/pulsar/pull/18056) - PIP-218: Consumer batchReceive() single partition every receive [#​18182](https://togithub.com/apache/pulsar/pull/18182) - PIP-229: Add a common interface to get fields of the MessageIdData [#​18950](https://togithub.com/apache/pulsar/issues/18950)([https://github.com/apache/pulsar/pull/18950](https://togithub.com/apache/pulsar/pull/18950)) - PIP-250: Add proxyVersion to CommandConnect [#​19623](https://togithub.com/apache/pulsar/issues/19623)([https://github.com/apache/pulsar/pull/19623](https://togithub.com/apache/pulsar/pull/19623)) - PIP-257: Add Open ID Connect Support to Server Components [#​19771](https://togithub.com/apache/pulsar/pull/19771) ##### Broker - \[Broker] incomplete PIP-97: Asynchronous Authentication Provider [#​12105](https://togithub.com/apache/pulsar/pull/12105) - Implement for ServerCnx by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​19409](https://togithub.com/apache/pulsar/pull/19409) - Implement for ProxyConnection by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​19292](https://togithub.com/apache/pulsar/pull/19292) - \[Broker] incomplete PIP-180: Shadow Topic, an alternative way to support readonly topic ownership. [#​16153](https://togithub.com/apache/pulsar/pull/16153) - Add ShadowManagedLedgerImpl by [@​Jason918](https://togithub.com/Jason918) in [#​18265](https://togithub.com/apache/pulsar/pull/18265) - Support shadow topic creation. by [@​Jason918](https://togithub.com/Jason918) in [#​17711](https://togithub.com/apache/pulsar/pull/17711) - Add Shadow Replicator by [@​Jason918](https://togithub.com/Jason918) in [#​17371](https://togithub.com/apache/pulsar/pull/17371) - \[Broker] PIP-192: New Pulsar Broker Load Balancer [#​16691](https://togithub.com/apache/pulsar/pull/16691) - Fix getLastMessageId for compressed payload(And add compression and maxBatchSize for the load balance system topic) by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​20087](https://togithub.com/apache/pulsar/pull/20087) - Improve TransferSheder for overload outlier for large clusters by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​20059](https://togithub.com/apache/pulsar/pull/20059) - Update the lookup data path to support deployment and rollback by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​19999](https://togithub.com/apache/pulsar/pull/19999) - Filter the transfer dest broker by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​19958](https://togithub.com/apache/pulsar/pull/19958) - Updated metrics and cleanup broker selector by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​19945](https://togithub.com/apache/pulsar/pull/19945) - Support delete namespace bundle admin API by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​19851](https://togithub.com/apache/pulsar/pull/19851) - Improved Auto Unload Logic by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​19813](https://togithub.com/apache/pulsar/pull/19813) - Support broker isolation policy by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​19592](https://togithub.com/apache/pulsar/pull/19592) - Add large topic count filter by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​19613](https://togithub.com/apache/pulsar/pull/19613) - Added VersionId in ServiceUnitStateData by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​19620](https://togithub.com/apache/pulsar/pull/19620) - Added Deleted and Init states in ServiceUnitState by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​19546](https://togithub.com/apache/pulsar/pull/19546) - Added broker and top-bundles load reporters by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​19471](https://togithub.com/apache/pulsar/pull/19471) - Added TransferShedder by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​18865](https://togithub.com/apache/pulsar/pull/18865) - Added ServiceUnitStateCompactionStrategy by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​19045](https://togithub.com/apache/pulsar/pull/19045) - Added TopicCompactionStrategy for StrategicTwoPhaseCompactor and TableView. by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​18195](https://togithub.com/apache/pulsar/pull/18195) - Implement load data store by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​18777](https://togithub.com/apache/pulsar/pull/18777) - Implement broker registry for new load manager by [@​Demogorgon314](https://togithub.com/Demogorgon314) in [#​18810](https://togithub.com/apache/pulsar/pull/18810) - Added ServiceUnitStateChannelImpl by [@​heesung-sn](https://togithub.com/heesung-sn) in [#​18489](https://togithub.com/apache/pulsar/pull/18489) - \[Broker] Pip-257: Add AuthenticationProviderOpenID by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​19849](https://togithub.com/apache/pulsar/pull/19849) - \[Broker] Make `LeastResourceUsageWithWeight` thread safe by [@​lifepuzzlefun](https://togithub.com/lifepuzzlefun) in [#​20159](https://togithub.com/apache/pulsar/pull/20159) - \[Broker] Support disabling delayed bucket merging. by [@​mattisonchao](https://togithub.com/mattisonchao) in [#​20155](https://togithub.com/apache/pulsar/pull/20155) - \[Broker] Supply download auth params when provided for k8s runtime by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20144](https://togithub.com/apache/pulsar/pull/20144) - \[Broker] AuthenticationProviderOpenID k8s error logs by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20135](https://togithub.com/apache/pulsar/pull/20135) - \[Broker] Implement authenticateAsync for AuthenticationProviderList by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20132](https://togithub.com/apache/pulsar/pull/20132) - \[Broker] Fix broker restart logic by [@​wolfstudy](https://togithub.com/wolfstudy) in [#​20113](https://togithub.com/apache/pulsar/pull/20113) - \[Broker] Ensure previous delayed index be removed from snapshotSegmentLastIndexTable & Make load operate asynchronous by [@​coderzc](https://togithub.com/coderzc) in [#​20086](https://togithub.com/apache/pulsar/pull/20086) - \[Broker] Fix avoid future of clear delayed message can't complete by [@​coderzc](https://togithub.com/coderzc) in [#​20075](https://togithub.com/apache/pulsar/pull/20075) - \[Broker] Refresh auth data if ProxyLookupRequests by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​20067](https://togithub.com/apache/pulsar/pull/20067) - \[Broker] Fix flaky testCreateTopicWithZombieReplicatorCursor by [@​BewareMyPower](https://togithub.com/BewareMyPower) in [#​20037](https://togithub.com/apache/pulsar/pull/20037) - \[Broker] Prevent range conflicts with Key Shared sticky consumers when TCP/IP connections get orphaned by [@​lhotari](https://togithub.com/lhotari) in [#​20026](https://togithub.com/apache/pulsar/pull/20026) - \[Broker] Fix leader broker log by [@​nicoloboschi](https://togithub.com/nicoloboschi) in [#​19987](https://togithub.com/apache/pulsar/pull/19987) - \[Broker] Make LedgerOffloaderFactory can load the old nar. by [@​horizonzy](https://togithub.com/horizonzy) in [#​19913](https://togithub.com/apache/pulsar/pull/19913) - \[Broker] Ignore and remove the replicator cursor when the remote cluster is absent by [@​BewareMyPower](https://togithub.com/BewareMyPower) in [#​19972](https://togithub.com/apache/pulsar/pull/19972) - \[Broker] Fix DeadLetterProducer creation callback blocking client io thread. by [@​lifepuzzlefun](https://togithub.com/lifepuzzlefun) in [#​19930](https://togithub.com/apache/pulsar/pull/19930) - \[Broker] Merge multiple buckets at once by [@​coderzc](https://togithub.com/coderzc) in [#​19927](https://togithub.com/apache/pulsar/pull/19927) - \[Broker] Fix the loss of bundle stats data reported to zookeeper, when the updateStats method is executed by [@​lordcheng10](https://togithub.com/lordcheng10) in [#​19887](https://togithub.com/apache/pulsar/pull/19887) - \[Broker] Clear delayed message when unsubscribe & Make clear operation asynchronous by [@​coderzc](https://togithub.com/coderzc) in [#​19901](https://togithub.com/apache/pulsar/pull/19901) - \[Broker] Fix can't send ErrorCommand when message is null value by [@​coderzc](https://togithub.com/coderzc) in [#​19899](https://togithub.com/apache/pulsar/pull/19899) - \[Broker] PIP-240: new public method unloadSubscription in PersistentTopic by [@​poorbarcode](https://togithub.com/poorbarcode) in [#​19737](https://togithub.com/apache/pulsar/pull/19737) - \[Broker] PIP-250: Add proxyVersion to CommandConnect by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​19618](https://togithub.com/apache/pulsar/pull/19618) - \[Broker] Make bucket merge operation asynchronous by [@​coderzc](https://togithub.com/coderzc) in [#​19873](https://togithub.com/apache/pulsar/pull/19873) - \[Broker] Suppress error logging when message expiration fails by [@​massakam](https://togithub.com/massakam) in [#​19778](https://togithub.com/apache/pulsar/pull/19778) - \[Broker] Allow proxy to pass same role for authRole and originalRole by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​19557](https://togithub.com/apache/pulsar/pull/19557) - \[Broker] Make authentication refresh threadsafe by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​19506](https://togithub.com/apache/pulsar/pull/19506) - \[Broker] Fix RetentionPolicies constructor by [@​nodece](https://togithub.com/nodece) in [#​19777](https://togithub.com/apache/pulsar/pull/19777) - \[Broker] Add metrics for bucket delayed message tracker by [@​coderzc](https://togithub.com/coderzc) in [#​19716](https://togithub.com/apache/pulsar/pull/19716) - \[Broker] Add topicName and cursorName for ledger metadata of bucket snapshot by [@​coderzc](https://togithub.com/coderzc) in [#​19802](https://togithub.com/apache/pulsar/pull/19802) - \[Broker] Don't clean up BucketDelayedDeliveryTracker when all consumer disconnect by [@​coderzc](https://togithub.com/coderzc) in [#​19801](https://togithub.com/apache/pulsar/pull/19801) - \[Broker] Fix create cluster with empty url by [@​nodece](https://togithub.com/nodece) in [#​19762](https://togithub.com/apache/pulsar/pull/19762) - \[Broker] Fix potential exception cause the policy service init fail. by [@​Technoboy-](https://togithub.com/Technoboy-) in [#​19746](https://togithub.com/apache/pulsar/pull/19746) - \[Broker] Validate originalPrincipal earlier in ServerCnx by [@​michaeljmarshall](https://togithub.com/michaeljmarshall) in [#​19270](https://togithub.com/apache/pulsar/pull/19270) - \[Broker] Fix issue where msgRateExpired may not refresh forever by [@​massakam](https://togithub.com/massakam) in [#​19759](https://togithub.com/apache/pulsar/pull/19759) - \[Broker] Fix index generator is not rollback after entries are failed added. by [@​gaozhangmin](https://togithub.com/gaozhangmin) in [#​19727](https://togithub.com/apache/pulsar/pull/19727) - \[Broker] Cut off snapshot segment according to maxIndexesPerBucketSnapshotSegment by [@​coderzc](https://togithub.com/coderzc) in [#​19706](https://togithub.com/apache/pulsar/pull/19706) - \[Broker] Change type of `allowAutoTopicCreationType` to TopicType by [@​yuruguo](https://togithub.com/yuruguo) in [#​18814](https://togithub.com/apache/pulsar/pull/18814) - \[Broker] Store the original authenticatio