Blogpost on what daq-proc can do

[eklem]

• [ ] First, make some designs to explain what the outcomes are
• [ ] Show how it is achieved (from documentation)
• [ ] Explain how this can lead to small, simple search engines in 50+ languages.

[eklem]

With word arrays (new regex in browser javascript) and stopwords, you can do a lot of cool things with plaintext or simple documents. In addition to stopword removal being good for search engine storage size and response.

Search concepts:

• [ ] Small indexes and fast response time - with stopword removal (both document processing and query processing)
• [ ] autocomplete - with ngrams
• [ ] fuzzy search- with Levenshtein matching
• [ ] filter on keywords - from automatic keyword calculation and/or keyword extreaction
• [ ] filter on email addresses - with email extraction
• [ ] filter on usernames - with username extraction
• [ ] filter on mood (emojis) - with emoji extraction
• [ ] hit highlighting - with hit-highlighter and fuzzy