zyedidia / micro

A modern and intuitive terminal-based text editor
https://micro-editor.github.io
MIT License
24.42k stars 1.16k forks source link

Change the line parsing and storage approach to reduce the overall line processing time #3149

Open JoeKar opened 4 months ago

JoeKar commented 4 months ago

The intention came up out of the discussion for #3127. We realized that the line is processed multiple times as bytes to receive the resulting runes and their count.

This can be significantly reduced by storing already the decoded runes per line while parsing that line the first time. Afterwards this line doesn't need to be decoded again and the count can be accessed by a simple usage of len().

Since this is a huge rework and change of one of the basics it might brake one or more interfaces used by plugins.

The change is still ongoing and a lot of depending functionalities need to be changed. So please expect rebases from time to time. I created the PR anyway since a lot of very important discussion was already ongoing within #3127 which shall be continued in here to keep the former one clean now.

In case someone else likes to support here then please provide patches and I can apply them. Otherwise please respect, that this can't be handled by me alone within a few days only, since I can't spend my whole free time for that. :wink:

BTW: make test runs successfully already.