TuGraph-family / tugraph-db

TuGraph: A High Performance Graph Database.
https://tugraph.org
Apache License 2.0
1.44k stars 195 forks source link

Add parser branch--for Enhancing parsing speed #537

Open Da1wn opened 6 months ago

Da1wn commented 6 months ago

For enhancing parsing speed with multicore

We have introduced a multi-layer finite state machine,

which serves as the basis for enhancing the speed of parallel processing of CSV files on single-machine multicore systems.

SIMD instruction sets are used to obtain the bitmap as quickly as possible.

The main modifications are in file src/import/RecordSet.h, RecordLoader.h, RecordLoader.cpp, CSVPathParser.h and CSVPathParser.cpp.

CLAassistant commented 6 months ago

CLA assistant check
All committers have signed the CLA.

CLAassistant commented 6 months ago

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.