apache / doris

Apache Doris is an easy-to-use, high performance and unified analytics database.
https://doris.apache.org
Apache License 2.0
12.78k stars 3.29k forks source link

[Bug] Paimon catalog can't read orc file from local filesystem #36508

Open MirrerZu opened 5 months ago

MirrerZu commented 5 months ago

Search before asking

Version

2.1.4

What's Wrong?

When create paimon catalog used local file system via 'file:', can't get any data from select sql. And be.WARNING log reported :

W20240619 10:40:28.923295 14875 file_system.cpp:35] [NOT_FOUND]failed to open file:/bigdata/paimon/test.db/
test1/bucket-0/data-f5fd76ac-0ef3-41dc-bfe9-9510c6b66a7c-0.orc

on the other hand, show databases and show create table work well

What You Expected?

please fix this, let doris can read paimon data from local file system.

How to Reproduce?

in flink sql client, create paimon catalog and insert some data.

CREATE CATALOG paimon WITH (
    'type' = 'paimon',
    'warehouse' = 'file:///bigdata/paimon'
);

USE CATALOG paimon;

create database test;
create table test.test1 (
id INT PRIMARY KEY NOT ENFORCED,
tchar CHAR(100),
tdecimal DECIMAL(12,3)
);

in doris, create paimon catalog and select ,would report a warning.

CREATE CATALOG `paimon_local` PROPERTIES (
"type" = "paimon",
"warehouse" = "file:///bigdata/paimon"
);

switch paimon_local;

SHOW CREATE TABLE test.test1;
SELECT * FROM test.test1;

Anything Else?

in Release 2.1.2 , doris works well

Are you willing to submit PR?

Code of Conduct

dahai1996 commented 5 months ago

遇到过这个问题,paimon格式设置为avro没问题。parquet,orc会出报错