[FEATURE] spark on k8s on s3 Running mode. Supports uploading log files to s3

[melin]

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

Search before asking

• [X] I have searched in the issues and found no similar issues.

Describe the feature

Aws serverless spark has a feature that periodically uploads log files to s3 during task execution, facilitating log viewing and simplifying spark log collection. Extending the open source version of spark enables similar functionality？

event log:

Motivation

No response

Describe the solution

No response

Additional context

No response

Are you willing to submit PR?

• [ ] Yes. I would be willing to submit a PR with guidance from the Kyuubi community to improve.
• [ ] No. I cannot submit a PR at this time.

[melin]

cc @pan3793 @zwangsheng