apache / pulsar

Apache Pulsar - distributed pub-sub messaging system
https://pulsar.apache.org/
Apache License 2.0
14.15k stars 3.57k forks source link

Scale up the pod number of bookie or broker cant improve the performance of throughput and my hardware resource is still free enough #13774

Open kingboung opened 2 years ago

kingboung commented 2 years ago

Describe the bug I deployed pulsar with k8s. We need 25w/s(1k size msg) throughput, however it can only provide 9w/s throughput with perf tool. By the way, its far away from the official test report. I tried to scale up the pod number of bookie and broker, but it worked nothing for me and I found my hardware resource is still free enough. What's wrong with my operation?

To Reproduce See description

Expected behavior Support horizontal expansion

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Additional context Add any other context about the problem here.

mattisonchao commented 2 years ago

@kingboung

Could you provide more details like "broker.conf", "bookkeeper.conf", machine resources, etc.? These are very useful for diagnosing your problem.

kingboung commented 2 years ago

@mattisonchao no problem, please see the zip file pulsar.zip pvc detail image

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.

github-actions[bot] commented 2 years ago

The issue had no activity for 30 days, mark with Stale label.