STINGER ingest rate slows dramatically during inserts

stingergraph / stinger

The STINGER in-memory graph store and dynamic graph analysis platform. Millions to billions of vertices and edges at thousands to millions of updates per second.

http://www.stingergraph.com

Other

210 stars 67 forks source link

STINGER ingest rate slows dramatically during inserts #170

Closed tgoodyear closed 7 years ago

tgoodyear commented 8 years ago

Possibly related to #131 , after ~30M edges the ingest rate drops below 10k/s on dev branch for graphs which contain high-degree vertices. Example edgelist available upon request.

ehein6 commented 8 years ago

High-degree vertices take longer to update due to the choice of data structure, but this slowdown is aggravated by the static work partitioning in the edge ingest for loop. A dynamic schedule with a large chunksize seems to help, see #198.

tgoodyear commented 7 years ago

I think this can be closed thanks to @ehein6's #208 PR