search

quintanar401 / connect-kdb-q

Query execution support for KDB-Q in Atom
MIT License
7 stars 5 forks source link

Atom will "block" when return a huge table #18

Closed cheduo closed 6 years ago

cheduo commented 6 years ago

Hi quintanar401,

Thanks for your excellent tool, connect-kdb-q; I use it a lot in my daily work.

Currently I find a small problem in using this package: I need to deal with huge table in my work, but when I query a huge table in Atom, it may "freeze" the editor, for example: q) tab /tab is a huge table

There's no calculation behind, but it take quite look time to return the result, some time it just crashes Atom.

I think in this case (for the huge table), it doesn't make sense in returning entire table, maybe we could just return first 10,000 lines of table. I could hack it in Q server in modifying .z.pg.

But I wonder whether we could limit the size of the return table in package size? Thanks,

quintanar401 commented 6 years ago

Hi, I've added limitResSize setting (1G by def). Msgs will be dropped and incoming data ignored if their size is more than this value.

cheduo commented 6 years ago

That's great ! Thanks