But first, we need to bench & profile our existing code to make sure we're not prematurely optimizing, and to figure out what other parts block the loop with intensive computation.
For now, the two obvious culprits look to be the numerous regex matches on strip-trackers, and the parsing & matching of HTML in cheerio in canonicization. Both are currently heavily cached.
https://nodejs.org/api/worker_threads.html
But first, we need to bench & profile our existing code to make sure we're not prematurely optimizing, and to figure out what other parts block the loop with intensive computation.
For now, the two obvious culprits look to be the numerous regex matches on strip-trackers, and the parsing & matching of HTML in cheerio in canonicization. Both are currently heavily cached.