openzim / python-scraperlib

Collection of Python code to re-use across Python-based scrapers
GNU General Public License v3.0
18 stars 16 forks source link

Leak in _libkiwix module #85

Closed rgaudin closed 2 years ago

rgaudin commented 2 years ago

zim._libkiwix module provides replicas of libkiwix features that we use to offer Counter metadata parsing.

There is apparently a leak that's not a big deal when dealing with individual ZIM files (as we do in CMS) but that becomes problematic when sequentially opening thousands ZIM files (library generation).