search

Yelp / pyleus

Pyleus is a Python framework for developing and launching Storm topologies.
Apache License 2.0
404 stars 113 forks source link

pyleus 0.2.4 bug: Num workers , Num executors in Strom UI #85

Open William-Sang opened 9 years ago

William-Sang commented 9 years ago 
$ git clone https://github.com/Yelp/pyleus.git
$ pyleus build pyleus/examples/exclamation_topology/pyleus_topology.yaml
$ pyleus local exclamation_topology.jar

That works well. However, when

$ pyleus submit -n NIMBUS_HOST exclamation_topology.jar

I submit the jar to the storm cluster.

Num workers is 16, Num executors is 1.

That maybe a bug.

qq20141212-1 2x

And plus, I want to roll back to 0.2.2, but I specific pyleus==0.2.2 in requirements.txt . It won't work.

$  pyleus --verbose build  pyleus/examples/exclamation_topology/pyleus_topology.yaml

It shows that : 

New python executable in /tmp/tmpuYS5z3/resources/pyleus_venv/bin/python
Installing setuptools, pip...done.
Downloading/unpacking pyleus==0.2.4
......

The version of pyleus is fixed! And I can't change it.

It occured to anyone?

poros commented 9 years ago

Regarding the second part of your issue, at the current stage of project, you can't run pyleus 0.2.4 on your dev environment and at the same time use a different version of pyleus in your topologies, because pyleus auto-install itself during the build of your package. If you want to switch to pyleus 0.2.2, you need to uninstall pyleus 0.2.4 also from your dev machine and install version 0.2.2 (you can get rid of the pyleus==0.2.2 line in the requirements.txt file as well).

William-Sang commented 9 years ago

@poros thanks for your reply.

wo142857 commented 8 years ago

how to uninstall pylesus? @William-Sang @poros

William-Sang commented 8 years ago

@wo142857 hava a try

pip uninstall pyleus