Use less meory - Githubissues

ndmitchell / weeder

Detect dead exports or package imports

BSD 3-Clause "New" or "Revised" License

124 stars 8 forks source link

Use less meory #25

Closed ndmitchell closed 7 years ago

ndmitchell commented 7 years ago

Currently on big projects Weeder uses lots of RAM. Two obvious improvements:

Use packed strings in the Hi data structure.
Only parse Hi files by need, rather than the full directory in advance.

ndmitchell commented 7 years ago

In fact, on the project I was interested in, the new version reduces memory from 1.3Gb to 38Mb, so it seems that simply forcing things at the right time was sufficient. At 38Mb it's harder to care, although using packaged strings is almost certainly morally the right thing to do.

ndmitchell commented 7 years ago

38Mb is basically zero nowadays, so closing this issue.