search

Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.87k stars 2.94k forks source link

${ALLUXIO_HOME}/journal didn't clean #18132

Open coldwind6 opened 1 year ago

coldwind6 commented 1 year ago

Alluxio Version: 2.9.3

Describe the bug the ${ALLUXIO_HOME}/journal/FileSystemMaster/v1/logs directory didn't clean, then It will lead to a shortage of space.

To Reproduce Steps to reproduce the behavior (as minimally and precisely as possible)

Expected behavior A clear and concise description of what you expected to happen.

Urgency Describe the impact and urgency of the bug.

Are you planning to fix it Please indicate if you are already working on a PR.

Additional context Add any other context about the problem here.

lucyge2022 commented 1 year ago

Hi, can you please further describe your issue and give more details in each of these sections?

coldwind6 commented 1 year ago

Hi, can you please further describe your issue and give more details in each of these sections?

The logs directory can't cleanup automatically. If there is no automatic cleanup policy, how should i to clean the logs directory，by the lastest modify time？

lucyge2022 commented 1 year ago

I'm not sure if these logs are the journal logs created at this path ${ALLUXIO_HOME}/journal/FileSystemMaster/v1/logs @yuzhu can u please help?

yuzhu commented 1 year ago

@coldwind6 those logs you are referring to are journal logs, and they should be check pointed regularly to save space. Are you running with an HA setup or just a single master? Could you post your site property file please?

coldwind6 commented 1 year ago

image @yuzhu Hello , it's running with HA by zookeeper, then the property file is above pic.

wjmmjr commented 6 months ago

I also encountered the same problem, It takes half an hour to read the FileSystemMaster/v1/logs files when the master starts. How did you solve this problem in the end?

coldwind6 commented 6 months ago

no，it's still open.

---- Replied Message ---- | From | @.> | | Date | 05/27/2024 13:42 | | To | @.> | | Cc | @.>@.> | | Subject | Re: [Alluxio/alluxio] ${ALLUXIO_HOME}/journal didn't clean (Issue #18132) |

I also encountered the same problem, It takes half an hour to read the FileSystemMaster/v1/logs files when the master starts. How did you solve this problem in the end?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>