Pometry / Raphtory

Scalable graph analytics database powered by a multithreaded, vectorized temporal engine, written in Rust

https://raphtory.com

GNU General Public License v3.0

310 stars 55 forks source link

Load LDBC into DiskGraph #1635

Open fabianmurariu opened 1 month ago

fabianmurariu commented 1 month ago

produce global node table with schema and unique identifier `type/id`

[ ] concatenate all the node tables
[ ] merge schema
[ ] sort by type/id

produce edge lists from the graph tables

[ ] join the graph tables onto the respective relations and produce the edge lists (where the relation is defined as a column in the node table)
[ ] sort all the edge lists by type/src_id, type/dst_id and createdTime if it exists

make the graph

[ ] Ingest the edge lists and the node properties