apache / incubator-graphar

An open source, standard data file format for graph data storage and retrieval.

https://graphar.apache.org/

Apache License 2.0

192 stars 40 forks source link

fix(spark): Fix the LdbcSample2GraphAr result and use csv as output #528

Closed acezen closed 1 week ago

acezen commented 1 week ago

Reason for this PR

527 describe

What changes are included in this PR?

The specified schema make the knows_edge_df got many wrong null value, use inferSchema to make the read operation to get a correct dataframe.
Since this is example, use csv as payload file output make more sense.

Are these changes tested?

yes

Are there any user-facing changes?

no