joelverhagen / NCsvPerf

A test bench for various .NET CSV parsing libraries
https://www.joelverhagen.com/blog/2020/12/fastest-net-csv-parsers
MIT License
69 stars 14 forks source link

Sep library now supports parallel processing #65

Closed burnchar closed 8 months ago

burnchar commented 8 months ago

RecordParser is no longer the only parallel CSV library.

🌪️ Multi-threaded - unparalleled speed with highly efficient parallel CSV parsing that is [up to 35x faster than CsvHelper]

Please add Sep tests with parallel support. I am curious if it can dethrone RecordParser!

joelverhagen commented 8 months ago

@nietras already submitted a PR. https://github.com/joelverhagen/NCsvPerf/pull/61

I just haven't gotten around to re-running the benchmarks and updating the blog. But based on his own runs (https://github.com/joelverhagen/NCsvPerf/pull/64) it's looking really good!

nietras commented 8 months ago

@burnchar thanks for paying attention, I have benched against RecordParser and Sep is definitely faster. I had hoped to blog about the release but occupied by other matters and experiments. Server GC is your friend!

burnchar commented 8 months ago

@burnchar thanks for paying attention, I have benched against RecordParser and Sep is definitely faster. I had hoped to blog about the release but occupied by other matters and experiments. Server GC is your friend!

I was not paying enough attention to notice that you had already sent a PR, but thank you both for your good work! Writing high-performance libraries helps both the community and even the environment, and researching and sharing performance comparisons of those libraries helps get people to actually use them.

joelverhagen commented 8 months ago

Updated the blog! https://www.joelverhagen.com/blog/2020/12/fastest-net-csv-parsers

burnchar commented 8 months ago

Thank you for your updated benchmarks, and for your work on NuGet.