Oracle DB Source : Failed to fetch schema. Please try again

[ifun248]

## Environment - **Airbyte version**: 0.40.16 and 0.40.16+ - **OS Version / Instance**: AWS EC2 - **Deployment**: Docker - **Source Connector and version**: Oracle DB 0.3.21

• Destination Connector and version: S3 0.3.17, Databricks Lakehouse 0.3.1 and Redshift 0.3.51
• Step where error happened: Setup new connection

Current Behavior

With Airbyte version 0.40.16 and 0.40.16+, when adding a connection from Oracle DB which configures a schema A contains more than 2000 tables to destinations, the step fetching the schema reports an error showed below:

Expected Behavior

With Airbyte version 0.40.16 and 0.40.16+, when adding a connection from Oracle DB which configures a schema B just contains 35 tables to destinations, the step fetching the schema is success.

With Airbyte version 0.40.0-alpha and 0.40.14, when adding a connection from Oracle DB which configures a schema A contains more than 2000 tables to destinations, the step fetching the schema below shows that Please wait a little bit more and is success finally.

With Airbyte version 0.40.0-alpha and 0.40.14, when adding a connection from Oracle DB which configures a schema B contains 35 tables to destinations, the step fetching the schema is also success.

Logs

From the behaviors above, I guess because fetching the schema of Oracle DB is too large which need take a long time, but maybe something process thinks of it taken timeout and killed it.

Are you willing to submit a PR?

No, thanks!

[mgarcs]

Faced same issue and I managed to solve it by tweaking the request timeout properties of the nginx server of airbyte-proxy as the underlying reason of that error is a request timeout.

http {
  server {
    listen 8000 default_server;
    proxy_read_timeout 300;
    proxy_connect_timeout 300;
    proxy_send_timeout 300;

....

Hope that helps in the meanwhile devs find a long-term solution to this.

[gongzexin]

I also encountered this problem. I tried to change the environment variable of image airbyte-proxy to BASIC_AUTH_PROXY_TIMEOUT=1800, but the problem did not solve.

[tarsisazevedo]

I changed this variable (BASIC_AUTH_PROXY_TIMEOUT) in the workers and it works fine integrating Netsuite ERP

[mihuajun]

There are over 8000 tables in my oracle So, do you have a solution to success