Teradata / PyTd

A Python Module to make it easy to script powerful interactions with Teradata Database in a DevOps friendly way.
MIT License
108 stars 43 forks source link

Load runs out of memory #120

Closed istvan-fodor closed 5 years ago

istvan-fodor commented 5 years ago

giraffez version 2.0.24.2 Teradata Load Utility Version 16.20.00.09 64-Bit Ubuntu 16.04 4 cores, 16 GB Ram

If I run the giraffez load operation for large CSVs, the process runs out of memory. I see on the command line the usual message (Processed X Rows), and I see in top that memory usage is slowly creeping up. After a while the process maxes out on memory around 16 GB and the giraffez process is killed. Is this expected? Or is there a configuration I am missing?

istvan-fodor commented 5 years ago

Sorry.. wrong project :)