search

Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.87k stars 2.94k forks source link

alter table command didn't work when used it on the Partitioned External hive table #18672

Open Qiliang-Huang opened 3 months ago

Qiliang-Huang commented 3 months ago

Alluxio Version: What version of Alluxio are you using? 2.4.1

Describe the bug A clear and concise description of what the bug is. I used the command "alter table u_user set location "alluxio://xxx" to change the location of partitioned external hive table.It didn't show any bugs.But when I queried the table,the data didn't cached in alluxio.However ,I created a new partitioned external hive table which was setted the location in alluxio .Then I use the command " hdfs put xx xx." .When I queried the table,the table can be cached in alluxio.

To Reproduce Steps to reproduce the behavior (as minimally and precisely as possible)

1.create a partitioned external hive table. 2.load data to the table. 3.use cammand "MSCK REPAIR TABLE xxx". 4.use cammad "select * from xxx where partition_column="xxx". 5.see the condition of the table on alluxio web.

Expected behavior A clear and concise description of what you expected to happen. The data of the table should be cached in alluxio.

Urgency Describe the impact and urgency of the bug. The function of cache will be invalid When use the partitioned external hive table.

Are you planning to fix it Please indicate if you are already working on a PR. No,thnks.

Additional context Add any other context about the problem here. the hive version:2.1.1+cdh6.3.2 the hadoop version:3.0.0+cdh6.3.2

littleEast7 commented 2 months ago

After using the command "alter table u_user set location "alluxio://xxx", how many times did you try to query the table? At the first time, the data didn't cached in alluxio is expected.

Qiliang-Huang commented 2 months ago

I have tried 5 times, it didn't work. But when I created a new partition,the data could be cached.

At 2024-09-19 18:32:34, "littleEast7" @.***> wrote:

After using the command "alter table u_user set location "alluxio://xxx", how many times did you try to query the table? At the first time, the data didn't cached in alluxio is expected.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>