search

DemandCube / DemandSpike

Load Testing Framework for Distributed Applications
GNU Affero General Public License v3.0
3 stars 5 forks source link

Sending custom kafka messages? #21

Open daluu opened 8 years ago

daluu commented 8 years ago

Hi, it looks like DemandSpike can publish messages into kafka for load generation against system that uses kafka. But looking at the readme, I was wondering if there's a way to specify the exact message (format/content) to send to kafka with DemandSpike. Or is it just a basic simple boilerplate message that gets sent only?

tuan08 commented 8 years ago

Hi,

The message is a wapper object, you can serialize any object to bytes, create a message with your bytes data

smorin commented 8 years ago

David, What kind of test are you looking to run? What would be the goal? -Steve

On Sun, Sep 20, 2015 at 7:58 PM, David Luu notifications@github.com wrote:

Hi, it looks like DemandSpike can publish messages into kafka for load generation against system that uses kafka. But looking at the readme, I was wondering if there's a way to specify the exact message (format/content) to send to kafka with DemandSpike. Or is it just a basic simple boilerplate message that gets sent only?

— Reply to this email directly or view it on GitHub https://github.com/DemandCube/DemandSpike/issues/21.

Steve Morin | Managing Partner - CTO

Nvent

O 800-407-1156 ext 803 <800-407-1156;803> | M 347-453-5579

smorin@nventdata.com smorin@nventdata.com

Executive Assistant

Caitlyn Fontes

T 774-328-1242 <774-328-1242>

cfontes@nventdata.com

Enabling the Data Driven Enterprise (Ask us how we can setup scalable open source realtime billion+ event/data collection/analytics infrastructure in weeks)

Service Areas: Management & Strategy Consulting | Data Engineering | Data Science & Visualization

BigData Technologies: Hadoop & Ecosystem | NoSql| Hbase | Cassandra | Storm | Spark | Kafka | Mesos | Docker | & More

Industries: IoT | Advertising | Retail | Manufacturing | TV & Cable | Energy | Oil & Gas | Insurance | Finance | Telecom

daluu commented 8 years ago

(End to end) system wide load testing, for a system that relies on kafka as messaging bus. And we send unique JSON payloads into kafka for consumption by our system's consumers. So we can't just send simple/dummy data messages, that's why I asked about this.

The goal would be to see how the overall system behaves under load, and how much load it can support with a given configuration (system is composed of microservices that we can scale, so we'd be testing with a certain scalability configuration to start with).

smorin commented 8 years ago

We can work with you on that we have a new version of DemandSpike coming out. -Steve

On Tue, Sep 22, 2015 at 7:14 PM, David Luu notifications@github.com wrote:

(End to end) system wide load testing, for a system that relies on kafka as messaging bus. And we send unique JSON payloads into kafka for consumption by our system's consumers. So we can't just send simple/dummy data messages, that's why I asked about this.

The goal would be to see how the overall system behaves under load, and how much load it can support with a given configuration (system is composed of microservices that we can scale, so we'd be testing with a certain scalability configuration to start with).

— Reply to this email directly or view it on GitHub https://github.com/DemandCube/DemandSpike/issues/21#issuecomment-142353068 .

Steve Morin | Hacker, Entrepreneur, Startup Advisor twitter.com/SteveMorin | stevemorin.com Live the dream start a startup. Make the world ... a better place.

daluu commented 8 years ago

Great, looking forward to that. We haven't started working on the load testing yet. I'm just exploring options right now.

On a related note, you have any thoughts on how this tool/framework compares to other more general purpose load test tools (with kafka specific plugins)? Like:

JMeter https://github.com/BrightTag/kafkameter

Gatling https://github.com/mnogu/gatling-kafka

smorin commented 8 years ago

Guess what's the specific need? Because there are few specific use-cases where demands pike excels

On Sep 22, 2015, at 20:57, David Luu notifications@github.com wrote:

Great, looking forward to that. We haven't started working on the load testing yet. I'm just exploring options right now.

On a related note, you have any thoughts on how this tool/framework compares to other more general purpose load test tools (with kafka specific plugins)? Like:

JMeter https://github.com/BrightTag/kafkameter

Gatling https://github.com/mnogu/gatling-kafka

— Reply to this email directly or view it on GitHub.