search

BradRuderman / pyhs2

MIT License
208 stars 107 forks source link

EOFError when using Kerberos with a result longer than 782 rows when arraysize value is 1000 #58

Open trixpan opened 8 years ago

trixpan commented 8 years ago

For some reason, after I moved my HiveServer2 setup to Kerberos I started receiving the following errors every time my query results cross 783 rows.

The issue seems to arraysize = 1000 in cursor.py

Changing the value to 700 seems to allow the query to complete

Would anyone know why? Should we change the default?

  File "/home/trixpan/TestReporting/Aggregation/HiveQueries/ACMEcorp/reports/emails/TopSources.py", line 48, in TopSources
    __results = cur.fetchall()
  File "/home/trixpan/reporting/lib/python2.6/site-packages/pyhs2/connections.py", line 58, in __exit__
    self.close()
  File "/home/trixpan/reporting/lib/python2.6/site-packages/pyhs2/connections.py", line 78, in close
    self.client.CloseSession(req)
  File "/home/trixpan/reporting/lib/python2.6/site-packages/pyhs2/TCLIService/TCLIService.py", line 184, in CloseSession
    return self.recv_CloseSession()
  File "/home/trixpan/reporting/lib/python2.6/site-packages/pyhs2/TCLIService/TCLIService.py", line 195, in recv_CloseSession
    (fname, mtype, rseqid) = self._iprot.readMessageBegin()
  File "/home/trixpan/reporting/lib/python2.6/site-packages/thrift/protocol/TBinaryProtocol.py", line 126, in readMessageBegin
    sz = self.readI32()
  File "/home/trixpan/reporting/lib/python2.6/site-packages/thrift/protocol/TBinaryProtocol.py", line 206, in readI32
    buff = self.trans.readAll(4)
  File "/home/trixpan/reporting/lib/python2.6/site-packages/thrift/transport/TTransport.py", line 63, in readAll
    raise EOFError()
EOFError