jameslittle230 / stork

🔎 Impossibly fast web search, made for static sites.
https://stork-search.net
Apache License 2.0
2.73k stars 56 forks source link

Word segmentation algorithm should split words on all punctuation #312

Open fingolfin opened 2 years ago

fingolfin commented 2 years ago

Try searching for "Burgh" or "Hume" on https://stork-search.net in the federalist papers. It shows zero matches. Yet on https://www.gutenberg.org/files/1404/1404-h/1404-h.htm#link2H_4_0016 it says

  1. Burgh's "Political Disquisitions."

and elsewhere

  1. Hume's Essays, Vol. I, p. 128: "The Rise of Arts and Sciences."

I would expect this to be found?

fingolfin commented 2 years ago

I also got zero hits searching for Abbé which occurs in l'Abbé but I am not sure whether that's the same issue or related to the accent?