search

reata / sqllineage

SQL Lineage Analysis Tool powered by Python
MIT License
1.3k stars 235 forks source link

Clickhouse SQL 'GLOBAL IN' not support #554

Closed xiao321 closed 5 months ago

xiao321 commented 8 months ago

Clickhouse SQL 'GLOBAL IN' not support

sqllineage -f ./sql-global-ck.sql --dialect=clickhouse

SELECT id, name FROM distributed_table WHERE id GLOBAL IN (SELECT id FROM local_table);

Line 1, Position 49: Found unparsable section: 'GLOBAL IN (SELECT id FROM local_table)'

Python 3.8 Sqllineage 1.5.0

maoxingda commented 8 months ago

This is not supported by the underlying sqlfluff, not by sqllineage.

reata commented 8 months ago

Upstream issue https://github.com/sqlfluff/sqlfluff/issues/5256 as reference.

Once they fix the issue and release a new version, we can upgrade the dependency and get this done.

reata commented 7 months ago

Upstream issue is fixed in sqlfluff==3.0.0a5. Since 3.0.0a5 is an alpha release, we will not upgrade sqllineage dependency and will wait for 3.0.0 instead. But you can manually upgrade your sqlfluff to get unblocked.