Wikipedia on Swarm Search Mechanism

Motivation:

E.T. wants to access Wikipedia, but the site is no longer accessible on the web.
They want to find a way to download the entire Wikipedia and access it offline, but this download requires a lot of traffic (500 GB of wiki mirror) and is difficult to update - there surely must be an easier, faster and more efficient way to access Wikipedia.
Fortunately, the Swarm network hosts a mirror of Wikipedia, so anyone connected to it can access and search through the complete set of information.
Wikipedia on Swarm is updated periodically (at minimum on a monthly basis) and is always accessible through the same link and the same means.

Goals:

This is “Wikipedia on Swarm” prize’s winner project. This bounty is to implement a search engine over the winning project’s dataset.
The search engine will have to be used to retrieve the desired page.
The search engine will have to offer “suggested words” when the user starts typing.
Create a reusable solution that provides broader utility - components can be reused to search through large collections of small files like other ZIM archives (e.g. Project Gutenberg) or OpenStreetMap data.
Create or modify a web interface and/or an app to allow searching and reading of Swarm hosted content.
Clear deployment instructions - Anyone without a devops background should be able to run the solution.

Note: Hosting of a database of this scale on Swarm has not been efficiently automated yet. As of today, the Bee client can reliably upload and retrieve small files. For larger datasets, an efficient mechanism for upload should be implemented.

Useful links:

Technical requirements:

It will have to be native compatible with the dataset of “Wikipedia on Swarm” prize’s winner project.
The judging panel will attempt to search for several random pages to ensure that English Wikipedia has been uploaded to Swarm mainnet as required for this bounty.

Assessment Criteria

Internal:

What is the final product’s user experience?
Does it offer suggested words?
How does it perform? We’d love the bounty to invite any innovation.
How much time/resources does it consume?

External:

Meeting the listed requirements.
Quality of implementation: code, documentation, technical excellence.
Quality of user experience (with regards to uploading and, more importantly, with regards to using the uploaded wikipedia).
How innovative is your solution?
Technical complexity and optimisations.

Code of Conduct

Let’s build exciting things.

Projects need to support privacy, data interoperability and data sovereignty where applicable. For more details, get familiar with Fair data society's principles. Prize challenge:

Prize challenge:

This bounty has a total value of 10k DAI to be disbursed in BZZ (as of the price of BZZ on the day of the payout as determined by Swarm Association).

The bounty will be assigned to the project and hacker that the judge committee will deem best at completing it. Priority will be given to hackers that successfully completed other bounties building on Swarm.

If according to the judging committee no project matches all the criteria mentioned above, no prizes will be awarded and the deadline might be extended.

Submission requirements

A final delivery will include:

Open source code licence:
any licence for the project shall include terms substantially similar to those of version 1.9 of the Open Source Definition, promulgated by the Open Source Initiative at https://opensource.org/osd-annotated.
Documentation: how to run, how it works
Recorded video demonstration of the working solution
A working link to a public Github or Gitlab repository containing: the code, presentations, demo, documentation, and licence information
The submitted solution must be a working product ready to be deployed in production already integrated with Wikipedia on Swarm Prize’s winner.
The solution uses Swarm network as the underlying storage

The judging panel will attempt to retrieve several random pages to ensure that English Wikipedia has been uploaded to Swarm mainnet as required for this bounty.

Eligibility Employees, contractors, or officers of Swarm Foundation and their affiliates are not eligible to participate in the bounty.

Participants can register as a team or as individuals. Participants can either join other teams or work alone. We believe in collaboration and encourage participants to work together.

Timeline The deadline for submitting your project is on February 14th 2023 at 16:00 CET.

Important Links

No Liability The participant acknowledges and agrees that, to the fullest extent permitted by law, he/she will not hold Swarm liable for any and all damages or injury whatsoever caused by or related to his/her participation to the bounty under any cause or action whatsoever of any kind, including, without limitation, actions for breach of warranty, breach of contract or tort (including negligence) and that Swarm shall not be liable for any indirect, incidental, special, exemplary or consequential damages, including for loss of profits, goodwill or data, in any way whatsoever arising out of the participation to the bounty.

Governing Law and Jurisdiction

These terms as well as all matters arising out or in relation to them shall be governed by the laws of Switzerland, to the exclusion of the rules on conflicts of laws.

Any claim or dispute regarding these terms or in relation to them shall be subject to the exclusive jurisdiction of the Courts of Neuchâtel, Switzerland, subject to an appeal at the Swiss Federal Court.

fairDataSociety / bounties