NEED SPEED UP. It is good but slow.

isagalaev / ijson

Iterative JSON parser with Pythonic interface

http://pypi.python.org/pypi/ijson/

Other

615 stars 134 forks source link

NEED SPEED UP. It is good but slow. #47

Closed fivejjs closed 8 years ago

fivejjs commented 8 years ago

Hi,

Is it possible speed up it with concurrent processing.

isagalaev commented 8 years ago

Did you try the CFFI backend?

As for concurrency, it's tricky in Python because of the GIL. And with multiple processes you'll loose much more on IPC than you gain from parallelizing.

fivejjs commented 8 years ago

I will try CFFI then. Thanks,