Open Da1wn opened 6 months ago
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.
For enhancing parsing speed with multicore
We have introduced a multi-layer finite state machine,
which serves as the basis for enhancing the speed of parallel processing of CSV files on single-machine multicore systems.
SIMD instruction sets are used to obtain the bitmap as quickly as possible.
The main modifications are in file src/import/RecordSet.h, RecordLoader.h, RecordLoader.cpp, CSVPathParser.h and CSVPathParser.cpp.