search

MathNya / umya-spreadsheet

A pure rust library for reading and writing spreadsheet files
MIT License
276 stars 44 forks source link

super slow #24

Closed cstkingkey closed 2 years ago

cstkingkey commented 2 years ago

when writing data to about 6000 cells, it took about 15min. The cpu usage is very high.

MathNya commented 2 years ago

Thank you for your report. We will look into improving the efficiency of the writing process. Please wait for our next update.

cstkingkey commented 2 years ago

Thank you for your report. We will look into improving the efficiency of the writing process. Please wait for our next update.

reading is super slow too. with debug profile, umya_spreadsheet::reader::xlsx::read(filename) took 35sec with a xlsx file which is 411kb.

cstkingkey commented 2 years ago

It seems that this crate will read whole workkbook, rather than the used sheet. And It will create a whole new workbook when saving rather than save the modified part.

At least, reading part can be changed to read sheets lazily.

MathNya commented 2 years ago

First of all, we reviewed the load-bearing processes without making major changes to the configuration. We will update it sequentially for further speed improvement.

cstkingkey commented 2 years ago

First of all, we reviewed the load-bearing processes without making major changes to the configuration. We will update it sequentially for further speed improvement.

Thanks for your excellent work and speedy response. With latest version, the read time drops from 35s to 30s.

MathNya commented 2 years ago

Thank you for the quick confirmation. We will aim to implement lazy loading as the next measure to improve processing speed.