Slowly when using multiple threads

traversc / qs

Quick serialization of R objects

397 stars 19 forks source link

Slowly when using multiple threads #86

Closed Yunuuuu closed 10 months ago

Yunuuuu commented 10 months ago

[R]> system.time(
         ascii_data <- qs::qread("munging/ascii_data.qs", nthreads = 10L)
     )
    user   system  elapsed 
 467.950 1187.845  165.595 

[R]> system.time(
         ascii_data <- qs::qread("munging/ascii_data.qs")
     )
   user  system elapsed 
119.951   5.576 125.522

traversc commented 10 months ago

Hi, most of the time is spent serially in R in reprocessing strings. The only thing that gets multithreaded is the decompression.

Also in the future, please give a reproducible example and complete description.