search

pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
http://streamparse.readthedocs.io/
Apache License 2.0
1.5k stars 218 forks source link

How to Change Topology Assigned Mem #323

Closed mbande closed 7 years ago

mbande commented 7 years ago

submitting a topology with defaults, the UI shows the value of 832MB in topology summary i couldn't find where it is set, or which config option is used for this how can i increase this value? can this value up to total worker machine memory?

Darkless012 commented 7 years ago

You can set any Apache Storm option (topology-wide) in config.json

"envs": {
    ...
    "dev": {
        ...
        "options": {
            "worker.heap.memory.mb": 1024
        }
    }
}

You will need to check Apache Storm configuration guide for the values needed.

mbande commented 7 years ago

thank you @Darkless012