Open gugu opened 2 years ago
@lupomontero sorry for mentioning you. Can you please review this PR? I think 300x speed boost can helpful change to this module
We frequently are parsing upwards of 100k domains. We love the accuracy of psl, but the performance of psl is a real hindrance. It would be great if the PR that addresses this could get reviewed/merged
Would love to see this get merged, it's insanely more performant
Hi there, many thanks for the proposal and apologies for the delay in dealing with this. I'm finally revamping this module and this is a very much needed improvement. I'll be reviewing this carefully tomorrow.
I've made some benchmarks and performance of psl is around 2k ops/sec:
by using maps it is possible to increase speed to 300k ops/sec: