search

ragibkl / adblock-dns-server

Adblock DNS Server powered by Bancuh DNS and dnsdist-acme
https://bancuh.com/
MIT License
63 stars 14 forks source link

Reduce compiler memory usage #162

Closed ragibkl closed 1 year ago

ragibkl commented 1 year ago

The compiler code currently process about 2.5 million blacklist with the current running config. It also does this in only a few minutes.

Unfortunately, it also ends up using almost 1GB of memory while doing it. When it does, memory usage blows up, and the bind/named process gets killed.

There should be a way to do this more efficiently, and maybe use less RAM at expense of longer runtime.

ragibkl commented 1 year ago

We're using the new ablc tool that I rebuilt separately in the dns_server now. It reduces memory usage a bit. I may be improved further, but I think for now this is solved.