search

pystorm / streamparse

Run Python in Apache Storm topologies. Pythonic API, CLI tooling, and a topology DSL.
http://streamparse.readthedocs.io/
Apache License 2.0
1.5k stars 218 forks source link

Does it support Python3 ? #457

Open tab-1 opened 5 years ago

tab-1 commented 5 years ago

Does it support Python3? Why can't I find the sample wordcount after using pip3 installation? streamparse install error info: Installing collected packages: MarkupSafe, jinja2, texttable, cython, simplejson, six, ruamel.yaml, pycparser, cffi, asn1crypto, cryptography, pynacl, pyasn1, bcrypt, paramiko, fabric3, pystorm, certifi, idna, chardet, urllib3, requests, ply, thriftpy, streamparse Segmentation fault (core dumped)

tab-1 commented 5 years ago

No such file: quickstart

dan-blanchard commented 5 years ago

It is almost exclusively used with Python 3 at this point. I was planning on removing support for Python 2 the next time we do a major release.

As for your issue, the segmentation fault makes it look like a problem with one of the other packages that streamparse relies on that use C extensions. Streamparse itself does not use any, so I don’t know what would cause that.

tab-1 commented 5 years ago

thanks,I used pip3 to install successfully, but I don't know how to add the streamparse path to the environment variable. I run sparse quickstart wordcount and the error is as follows:

Command 'sparse' not found, but can be installed with: Sudo apt install sparse

Can you tell me how to configure streamparse?

tab-1 commented 5 years ago

I am in the virtual environment of python3, the installation through the source code is successful, Python setup.py develop Does streamparse have to be installed in a virtual environment? Running in a production cluster also requires creating a virtual environment to run?

amilgrom commented 4 years ago

@dan-blanchard Could this be caused by the fact that thriftpy is still in the requirements? thriftpy only officially supports up to python 3.5. thriftpy2 is the drop in place successor with support for 2.7 and 3.4-7+ (https://pypi.org/project/thriftpy2/)

I actually found this thread because I have some software that needs to migrate to 3.7 and we're seemingly blocked by streamparse's reliance on thriftypy. And idea when we might see support for 3.7? Would be happy to contribute the changes to jump from thriftpy to thriftpy2 to help speed things along

dan-blanchard commented 4 years ago

I had no idea thriftpy had been deprecated and replaced by thriftpy2. Any PRs to address that would be very welcome!

On Thu, May 14, 2020 at 8:30 PM Andrew Milgrom notifications@github.com wrote:

@dan-blanchard https://github.com/dan-blanchard Could this be caused by the fact that thriftpy is still in the requirements? thriftpy only officially supports up to python 3.5. thriftpy2 is the drop in place successor with support for 2.7 and 3.4-7+ ( https://pypi.org/project/thriftpy2/)

I actually found this thread because I have some software that needs to migrate to 3.7 and we're seemingly blocked by streamparse's reliance on thriftypy. And idea when we might see support for 3.7? Would be happy to contribute the changes to jump from thriftpy to thriftpy2 to help speed things along

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/Parsely/streamparse/issues/457#issuecomment-628956314, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAHOLWJZ7E2Y26232ZNSZZDRRSEJRANCNFSM4GYSNF2Q .

-- Dan Blanchard | Software Engineer