openzim / sotoki

StackExchange websites to ZIM scraper
https://library.kiwix.org/?category=stack_exchange
GNU General Public License v3.0
222 stars 26 forks source link

Integrated search engine #1

Closed amirouche closed 7 years ago

amirouche commented 9 years ago

I think it will be better to have a search engine integrated to the static version of the website. The problem is that the index is too big to be built by the user even for superuser (20MB). lunrjs provide numerous entry points. Here is the solutions that remains to be explored:

I think it's better to contribute back to lunr.js which is an established project regarding this topic. I had a look a look at other solutions but they more complicated and we only require english support.

Maybe it's better to thing I18N and go with a FTS solution that can handle mutliple languages. Again, I think it's better to have search integrated to the static part of the ZIM file that have search engine built inside the kiwix reader which breaks UX.

kelson42 commented 9 years ago

Did you have had a look to the solution used for Gutenberg? I would recommend to get the static pages done and correctly linked. Make a first version and then work on this. Meanwhile the reader fulltext search engine should do the job.

amirouche commented 9 years ago

This is kind of complex. I'd like to do a first release before working on that.

dattaz commented 7 years ago

As discuss with @kelson42 search in zimlib, will, for the moment and for the use case, be enough