search

exxeleron / qPython

interprocess communication between Python and kdb+
http://www.devnet.de
Apache License 2.0
152 stars 89 forks source link

Error while data decompression #69

Open gowestyang opened 5 years ago

gowestyang commented 5 years ago

My q query can be executed correctly in a q session. But in qPython, sometimes I receive "Error while data decompression", while other times I can query correctly. What is the meaning of this error?

sean185 commented 5 years ago

Hi there, facing the same issue here. From observation, this seems to be an issue when you max out 2gb, or 2^21 bytes.

I think this is to do with this line of code here: https://github.com/exxeleron/qPython/blob/master/qpython/qreader.py#L494

I wonder if there is a limit to the IPC throughput, hence the hardcoded limit? Just want to know what's the speed limit here 😄