When running the url taggers a significant amount of time is spent loading the domain blocklists from file, because it has to reload the blocklist every time the parallel processor moves on to a new file. This change will precompile the regex patterns so the regex engine doesn't have to compile internally for every line in the blockfile.
When running the url taggers a significant amount of time is spent loading the domain blocklists from file, because it has to reload the blocklist every time the parallel processor moves on to a new file. This change will precompile the regex patterns so the regex engine doesn't have to compile internally for every line in the blockfile.