search

keboola / db-extractor-mssql

MIT License
1 stars 2 forks source link

Sed timeout #136

Closed odinuv closed 5 years ago

odinuv commented 5 years ago

Got this error:

[in.c-keboola-ex-db-mssql-61167227.raw-50001]: The BCP export failed: The process "sed -e 's/^\x00,/,/g;s/,\x00,/,,/g;s/,\x00$/,/g' -i /data/out/tables/in.c-keboola-ex-db-mssql-61167227.raw-50001.csv" exceeded the timeout of 300 seconds.. Attempting export using pdo_sqlsrv.
Executing "SELECT [UID], char (34) + COALESCE(REPLACE ([SRC_IP], char (34), char (34) + char (34)), '') + char (34) AS [SRC_IP], char (34) + COALESCE(REPLACE ([DST_IP], char (34), char (34) + char (34)), '') + char (34) AS [DST_IP], [SRC_IF], [DST_IF], [APP_ID], [PROT_ID], [PORT], [DST_PORT], [OCTETS], CONVERT(DATETIME2(0), [FLOW_START_TIME]) AS [FLOW_START_TIME], CONVERT(DATETIME2(0), [FLOW_END_TIME]) AS [FLOW_END_TIME], CONVERT(DATETIME2(0), [COLLECTION_TIME]) AS [COLLECTION_TIME], [PACKETS] FROM [dbo].[Raw_50001] WHERE 1=1 AND [COLLECTION_TIME] BETWEEN DATEADD(DD, -30, GETDATE()) AND GETDATE();" via PDO

I'm not sure if it means that there is something wrong, or if the sed can really take this long and it's worth increasing the timeout.

https://connection.eu-central-1.keboola.com/admin/projects/399/jobs/64336607?q= https://keboola.zendesk.com/agent/tickets/11306

pivnicek commented 5 years ago

hmmm, that's a new one. what is the size of the output? Increasing the timeout seems like a reasonable thing to do.

odinuv commented 5 years ago

hm, Sam says 200M, so I can imagine it's quite large