I sped up the wyr and lowered the CPU load. It went from 0.3 seconds to 0.02 seconds for me and from 25% CPU to 3%.
Sadly it seems like rrrather is dead, so I couldn't use that.
I went ahead and removed all the comments from the bare html before pushing it into BeautifulSoup to search in it
I sped up the wyr and lowered the CPU load. It went from 0.3 seconds to 0.02 seconds for me and from 25% CPU to 3%. Sadly it seems like rrrather is dead, so I couldn't use that. I went ahead and removed all the comments from the bare html before pushing it into BeautifulSoup to search in it