search

ldbc / ldbc_graphalytics_platforms_graphblas

LDBC Graphalytics implementation using SuiteSparse:GraphBLAS and LAGraph
Apache License 2.0
4 stars 7 forks source link

Use binary format for loading matrices #12

Closed szarnyasg closed 4 years ago

szarnyasg commented 4 years ago

LAGraph_grread support loading graphs in Galois format. These (I think) can be generated with the Galois library's galois::graphs::FileGraph::toFile method. LAGraph supports reading graphs but does not yet support generating these, see: https://github.com/GraphBLAS/LAGraph/blob/b5f047e600773f686b5f2f2e40f9af6f67d4231c/TODO.txt#L30

hegyibalint commented 4 years ago

What is the advised way of transforming our source graphs to this format? Currently we use our Julia-based converter for MM, but I see no appropriate binding for Galois.

szarnyasg commented 4 years ago

Probably this library - https://iss.oden.utexas.edu/projects/galois/api/current/classgalois_1_1graphs_1_1FileGraph.html But this is not a high-priority issue - eventually, LAGraph will provide built-in support for this format.

hegyibalint commented 4 years ago

But even in that case, we would need to convert the raw datasets into remapped matrices, and this is an obvious conversion step. You mean by LAGraph support to not write a converter directly to Galois format, but follow the Graphalytics -[converter]-> MM -[LAGraph serializer]-> Galois binary chain?

szarnyasg commented 4 years ago

You mean by LAGraph support to not write a converter directly to Galois format, but follow the Graphalytics -[converter]-> MM -[LAGraph serializer]-> Galois binary chain?

Yes - we only need to do this once.

szarnyasg commented 4 years ago

LAGraph_binread and LAGraph_binwrite are now out! https://github.com/GraphBLAS/LAGraph/tree/master/Source/Utility

szarnyasg commented 4 years ago

Done!