cameron / squirt

Speed read the web.
http://www.squirt.io
Apache License 2.0
1.22k stars 206 forks source link

Detection and Removal of Repeats #164

Open davemenc opened 10 years ago

davemenc commented 10 years ago

A long series of dashes (--------------------------------------------------------------------------) (for example here:

https://www.linkedin.com/today/post/article/20140703220143-16202502-why-they-rejected-the-best-hr-candidate-they-d-ever-interviewed-the-shocking-truth-revealed?trk=tod-home-art-list-large_0)

causes it to show each individual dash. I thought it had stalled but, no, it was just working through the list.

This case could safely be detected and removed. I think, in general, any long list of repeated characters (more than 3, I should think) could be removed safely.