search

projectEndings / staticSearch

A codebase to support a pure JSON search engine requiring no backend for any XHTML5 document collection
https://endings.uvic.ca/staticSearch/docs/index.html
Mozilla Public License 2.0
46 stars 21 forks source link

Fix with accompanying test for issue #300, mishandling of U_A78F. #301

Closed martindholmes closed 2 months ago

martindholmes commented 2 months ago

Simple fix and test to accompany it. Once merged into dev, I'll backport the fix to the 1.4 branch.

joeytakeda commented 2 months ago

This is an interesting problem! I think special casing works well for this for now, but it would be good if this could be configurable externally (in case there are other characters like this or if people want to tokenize words in a special way). But this looks good to me, so I'll merge it in