search

jqnatividad / qsv

Blazing-fast Data-Wrangling toolkit
https://qsv.dathere.com
The Unlicense
2.51k stars 71 forks source link

`luau`: context-aware multi-threading #1398

Open jqnatividad opened 1 year ago

jqnatividad commented 1 year ago

When the luau script is only doing row-level operations, it won't need to maintain globals and the special variables, and therefore, can be multi-threaded as well.

Automatically detect when this condition is satisfied, and then go into multi-threaded, sequential mode. This will greatly increase performance.

jqnatividad commented 3 weeks ago

Do this once mlua 0.10.0 is released https://github.com/mlua-rs/mlua/blob/main/docs/release_notes/v0.10.md