ClickHouse / clickhouse-jdbc-bridge

A JDBC proxy from ClickHouse to external databases
Apache License 2.0
167 stars 60 forks source link

JDBC FOR ORACLE FAILED #143

Open ldboyghg opened 2 years ago

ldboyghg commented 2 years ago

HI
CASE : jdbc connect oracle

i want to get BigData from oracle by jdbc

when i spend Single query ,client dbeaver could return correctly data with a little slowly.

querySql:select * from jdbc("jdbc:oracle:thin:user/passwd@host:port:instance", "query");

BUT JDBC bridge server print some info on background like this :

[2022-03-11 11:35:34] [INFO ] Raw query: SELECT FROM bigTable [2022-03-11 11:35:34] [WARNING] Failed call setClientInfo due to Invalid or unsupported name for clientInfo. [2022-03-11 11:35:34] [INFO ] Executing query(schema=[]): SELECT FROM bigTable [2022-03-11 11:35:34] [WARNING] Failed call setClientInfo due to Invalid or unsupported name for clientInfo. [2022-03-11 11:35:39] [SEVERE ] Caught exception [2022-03-11 11:35:39] [SEVERE ] Caught exception [2022-03-11 11:35:39] [WARNING] Still have at least 56100 bytes in buffer [2022-03-11 11:35:39] [SEVERE ] Failed to respond

is client buffer not enough or my query outtime?
where could i set these params.?

thank you.

ldboyghg commented 2 years ago

when i run the same Sql in clickhouse-client , promt like this :

DB::Exception: Cannot read from istream at offset 375390208: While executing BinaryRowInputFormat: While executing JDBC. (CANNOT_READ_FROM_ISTREAM)

ldboyghg commented 2 years ago

JDBC bridge timeout, for examples: queryTimeout in config/server.json, and maxWorkerExecuteTime in config/vertx.json these params wo changed *10, but no effect.

zhicwu commented 2 years ago

How long it takes for the query on Oracle?

ldboyghg commented 2 years ago

The table is a width result tab on oracle in DWD level. ,4000W rows.

ldboyghg commented 2 years ago

在oracle已经是个结果落地的结果表了, 在不加载所有数据的情况下, 查询是秒出结果,但是通过jdbc客户端就很慢.

zhicwu commented 2 years ago

The table is a width result tab on oracle in DWD level. ,4000W rows.

What's the max_execution_time in ClickHouse? And if you're using JDBC to access ClickHouse, what's the socket_timeout?

ldboyghg commented 2 years ago

The table is a width result tab on oracle in DWD level. ,4000W rows.

What's the max_execution_time in ClickHouse? And if you're using JDBC to access ClickHouse, what's the socket_timeout?

thank you very much . I seted params max_exection_time 600

ldboyghg commented 2 years ago

It could run success. i will compare it to datax etl , thanks again.