[Bug] An error occurs when pyspark3.3.2 runs `createDataFrame`

[guoshupei]

Search before asking

• [X] I searched the issues and found no similar issues.

Linkis Component

linkis-engineconnn-plugin

Steps to reproduce

code

import numpy as np

# 创建一个包含随机数的NumPy数组
numpy_array = np.random.rand(5, 5)
#
## 将NumPy数组转换为Spark DataFrame
df = spark.createDataFrame(numpy_array.tolist(), schema = ["col1", "col2", "col3", "col4", "col5"])

# 展示DataFrame
df.show()

# 停止SparkSession
#spark.stop()

print("+++++++++++++++++++++++numpy test=======================")

error

Expected behavior

Run successfully

Your environment

• Linkis version used: 1.3.2
• Environment name and version:
  • spark-3.3.2

Anything else

No response

Are you willing to submit a PR?

• [X] Yes I am willing to submit a PR!

[github-actions[bot]]

:blush: Welcome to the Apache Linkis community!!

We are glad that you are contributing by opening this issue.

Please make sure to include all the relevant context. We will be here shortly.

If you are interested in contributing to our website project, please let us know! You can check out our contributing guide on :point_right: How to Participate in Project Contribution.

Community

WeChat Assistant	WeChat Public Account

Mailing Lists

Name	Description	Subscribe	Unsubscribe	Archive
dev@linkis.apache.org	community activity information	subscribe	unsubscribe	archive