Execute Spark writing to HDFS reports no permission

[wangchao732]

What happened?

When building the container, use ARG spark_uid=0 (root) and set the directory permissions to 777 Caused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=spark, access=WRITE, inode="/spark/farm_history/_temporary/0":root:supergroup:drwxr-xr-x ,

当我修改hdfs目录权限，它又报错

Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=root, access=WRITE, inode="/spark/farm_history/_SUCCESS":spark:spark:-rw-r--r--

Reproduction Code

/

Expected behavior

No response

Actual behavior

No response

Environment & Versions

• Kubernetes Version: 1.24.17
• Spark Operator Version: 2.0.2
• Apache Spark Version: 3.4.3

Additional context

No response

Impacted by this bug?

Give it a 👍 We prioritize the issues with most 👍