search

capitalone / giraffez

User-friendly Teradata client for Python
https://capitalone.github.io/giraffez
Apache License 2.0
108 stars 35 forks source link

BulkExport closes connection without any error #74

Open andvikt opened 4 years ago

andvikt commented 4 years ago

Hy!

Very strange issue: when exporting a huge table (18millions rows, 120 columns) with BulkExport, it is randomly closing connection between 2-2.6 millions (7-9 minutes of running).

I've set logging_level to DEBUG, but nothing unusual there: it is showing that PT request is complete, PT connection is closed!

With ViewPoint I can see that I have 5 sessions and all of them are active while data is downloading.

With pyodbc I can download all the 18 millions of rows without any issue (except i must wait half a day)

How can I get the reason of that behaviour?

I have an idea: maybe I recieve only data from one of the 5 sessions? How can I limit those number of sessions to one?

CharlieTruong commented 3 years ago

I've also experienced a similar issue. I can't tell if it's the server closing the connection or on my end. The connection just closes but in reality there are many more records to export. There doesn't seem to be a timeout option that I can tell?