search

danthegoodman1 / RustyGraphDB

Learning graph DBs in Rust
0 stars 0 forks source link

Persistence and serialization #3

Open danthegoodman1 opened 2 weeks ago

danthegoodman1 commented 2 weeks ago

Persist the datsets to disk.

When serializing, have some tracking (map? on-disk KV so low mem?) so we can check whether we already serialized a given node so that when we are recording the relations we don't need to double record if we've already recorded the target node (since that will have recorded the relation back to the current node).

danthegoodman1 commented 2 weeks ago

Maybe we get this natively with persistence by only recording the relationship with the node created last (if we create the relationship with the node). If both nodes already exist then we can attach it to the one with the lexographically smaller ID.

danthegoodman1 commented 2 weeks ago

Should plan some native backup and changefeed features as well

danthegoodman1 commented 3 days ago

Maybe we can plan that users should intend node information to be mostly in another database, with the info stored here being just enough to find relations and IDs to do other lookups.

Then this becomes a sort of external graph index rather than a graph DB.