search

Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.82k stars 2.93k forks source link

"ls" a file and its parent directory may have inconsistent results #18270

Open secfree opened 11 months ago

secfree commented 11 months ago

Alluxio Version: The latest "master" branch - "305-SNAPSHOT"

Describe the bug "ls" a file and its parent directory may have inconsistent results

To Reproduce Here is an example

$ ./bin/alluxio fs ls -f /
-rw-rw-r--  test   test             1366                 10-02-2023 17:39:54:284 FILE /file.01
-rw-rw-r--  test   test             1366                 10-02-2023 17:41:37:496 FILE /file.02
-rw-rw-r--  test   test             1366                 10-03-2023 11:04:18:177 FILE /file.03

// create a new file "/file.04" in UFS

$ ./bin/alluxio fs ls /file.04
-rw-rw-r--  test   test             1366                 10-03-2023 11:12:57:668 FILE /file.04

$ ./bin/alluxio fs ls /
-rw-rw-r--  test   test             1366                 10-02-2023 17:39:54:284 FILE /file.01
-rw-rw-r--  test   test             1366                 10-02-2023 17:41:37:496 FILE /file.02
-rw-rw-r--  test   test             1366                 10-03-2023 11:04:18:177 FILE /file.03

Expected behavior "ls" a file and its parent directory should have consistent results.

secfree commented 11 months ago

Maybe my previous propose is a solution to solve such inconsistency issues: Guarantee Consistency of Alluxio without Redundant Metadata Sync