search

mldbai / mldb

MLDB is the Machine Learning Database
http://mldb.ai
Apache License 2.0
661 stars 102 forks source link

MLDB-2191 import text memory allocations #888

Closed jeremybarnes closed 7 years ago

jeremybarnes commented 7 years ago

Reduces memory allocations in the tight loop of text import, improving throughput by around 10%.

The test failure is spurious.

jeremybarnes commented 7 years ago

It's a private customer benchmark, but any with an import text phase will benefit.