Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.84k stars 2.94k forks source link

the cmd persist stuck #14686

Open lilyzhoupeijie opened 2 years ago

lilyzhoupeijie commented 2 years ago

Alluxio Version: alluxio 2.6.0,alluxio 2.8.0

Describe the bug using cmd as follows: alluxio fs persist /bzzp-blue-geekrec-sample/blue_pt_rank/feat_v4/2021-09-09 and the cmd will never return

To Reproduce every alluxio cluster ,and every directory

Expected behavior the cmd should have return and exec rightly

Urgency when somes files not persist to ceph with async_through,we will try to persist them using persist cmd.

yuzhu commented 2 years ago

@lilyzhoupeijie could you provide more information? could you check if there are job failures with alluxio job ls and alluxio job stat -v jobid to get more details? if the job is successful, then can you look at the master log to see if it has trouble renaming? we are aware of this issue and will create some changes for more meaningful error messages instead of hanging behavior.

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions.