search

snowflakedb / snowflake-ingest-java

Java SDK for the Snowflake Ingest Service -
http://www.snowflake.net
Apache License 2.0
71 stars 57 forks source link

Client configure request failed #820

Open szkoludasebastian opened 2 months ago

szkoludasebastian commented 2 months ago

During ingesting data we noticed this kind of error:

net.snowflake.ingest.utils.SFException: Client configure request failed: Timeout waiting for connection from pool. at net.snowflake.ingest.streaming.internal.InternalStageManager.<init>(InternalStageManager.java:95) at net.snowflake.ingest.streaming.internal.SnowflakeStreamingIngestClientInternal.<init>(SnowflakeStreamingIngestClientInternal.java:226) at net.snowflake.ingest.streaming.internal.SnowflakeStreamingIngestClientInternal.<init>(SnowflakeStreamingIngestClientInternal.java:261) at net.snowflake.ingest.streaming.SnowflakeStreamingIngestClientFactory$Builder.build(SnowflakeStreamingIngestClientFactory.java:60) Caused by: net.snowflake.client.jdbc.internal.apache.http.conn.ConnectionPoolTimeoutException: Timeout waiting for connection from pool at net.snowflake.client.jdbc.internal.apache.http.impl.conn.PoolingHttpClientConnectionManager.leaseConnection(PoolingHttpClientConnectionManager.java:316) at net.snowflake.client.jdbc.internal.apache.http.impl.conn.PoolingHttpClientConnectionManager$1.get(PoolingHttpClientConnectionManager.java:282) at net.snowflake.client.jdbc.internal.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:190) at net.snowflake.client.jdbc.internal.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186) at net.snowflake.client.jdbc.internal.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89) at net.snowflake.client.jdbc.internal.apache.http.impl.execchain.ServiceUnavailableRetryExec.execute(ServiceUnavailableRetryExec.java:85) at net.snowflake.client.jdbc.internal.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110) at net.snowflake.client.jdbc.internal.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185) at net.snowflake.client.jdbc.internal.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83) at net.snowflake.client.jdbc.internal.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108) at net.snowflake.ingest.streaming.internal.StreamingIngestUtils.executeWithRetries(StreamingIngestUtils.java:135) at net.snowflake.ingest.streaming.internal.StreamingIngestUtils.executeWithRetries(StreamingIngestUtils.java:109) at net.snowflake.ingest.streaming.internal.StreamingIngestUtils.executeWithRetries(StreamingIngestUtils.java:95) at net.snowflake.ingest.streaming.internal.SnowflakeServiceClient.executeApiRequestWithRetries(SnowflakeServiceClient.java:190) at net.snowflake.ingest.streaming.internal.SnowflakeServiceClient.clientConfigure(SnowflakeServiceClient.java:61) at net.snowflake.ingest.streaming.internal.InternalStageManager.<init>(InternalStageManager.java:73) ... 43 common frames omitted

Do you know maybe what could be the reason of this error?

sfc-gh-xhuang commented 2 months ago

@szkoludasebastian Which sdk version are you using that hits this? how often does this occur and when? Is it during the open channels request?

Please open a support case with some logs as that will help us debug further with you