search

sunui / nopala

Impala and Hive client for Nodejs
3 stars 0 forks source link

1024 rows limit #1

Open alexsutu opened 4 years ago

alexsutu commented 4 years ago

Great repo, looks promising, thanks for that. I just tried both hiveserver2 and beeswax protocols and every time I query I get a maximum of 1024 rows. Any thoughts on what the problem may be?

lenchv commented 4 years ago

Hi @alexsutu ! It is strange, that you get 1024, because of the size of block by default 5120. Anyway, my theory is that you you fetch only first block. As I know, when you fetch the result the hive returns it by portions. It means, if fetchBlock returns hasMoreRows: true, you have to call fetchBlock one more time. BTW, you can try hive-driver, it should work well, if not you can create an issue and I will explain with more details. Thanks.