Number of named files in PUT.

inquidia / PentahoSnowflakePlugin

Apache License 2.0

5 stars 10 forks source link

Number of named files in PUT. #13

Open CJamesDuo opened 7 years ago

CJamesDuo commented 7 years ago

Just ran across an issue where after the files are staged it tries to put all named file in the PUT command exceeding the 1000 named file limit. Should issue separate put commands every 1000 files to stay with these limits.

CJamesDuo commented 7 years ago

Looks like the fix can easly fit in PentahoSnowflakePlugin/src/org/inquidia/kettle/plugins/snowflakeplugin/bulkloader/SnowflakeBulkLoader.java - loadDatabase() method.