search

ClickHouse / libhdfs3

HDFS file read access for ClickHouse
Apache License 2.0
36 stars 56 forks source link

libhdfs3: add log for slow read #47

Closed liubingxing closed 1 year ago

liubingxing commented 1 year ago

Add log for slow read and we can get the duration of each read operation by opening debug logs. image

liubingxing commented 1 year ago

@zhanglistar @taiyang-li @lgbo-ustc Please take a look.

liubingxing commented 1 year ago

@tavplubix Thanks for your suggestion, I have made some modifications to this Pr. 1、Add slow read logs to identify the bad performance of HDFS cluster 2、Print the duration of each read operation in the debug log Please take a look again, thanks a lot.

tavplubix commented 1 year ago

Do you need these changes for a Pull Request in https://github.com/ClickHouse/ClickHouse? Which one?

liubingxing commented 1 year ago

Do you need these changes for a Pull Request in https://github.com/ClickHouse/ClickHouse? Which one?

@tavplubix ClickHouse/ClickHouse#54057

Please take a look again.

tavplubix commented 1 year ago

See the discussion in https://github.com/ClickHouse/ClickHouse/pull/54057