Best upload of Wikipedia mirror to Swarm

costgallo commented 2 years ago

Prize Bounty

1 winner of 5000 BZZ

Challenge Description

Swarm decentralized, peer-to-peer storage opens up new opportunities for establishing a self-sovereign cloud. It also brings about a paradigm shift on how to use such storage.

For this bounty, we challenge you to create a read only version of Wikimedia on Swarm, following this procedure:

Take the ZIM file https://download.kiwix.org/zim/wikipedia/wikipedia_bm_all_maxi_2022-02.zim .
Explode it in the corresponding set of HTML/CSS/JS fils with tool zimdump of zim-tools (binaries for GNU/Linux).
Upload to Swarm.

You should create a docker file which takes as an input zim file, and outputs swarm hash of the uploaded content. The swarm-index-document should be set to an index.html which provides relative links to all uploaded pages

The long term goal is to have a better Wikipedia on Swarm, what does “better” mean? Your imagination is the only limit.

This bounty is in partnership with Kiwix

Submission Requirements

Open source code license
- Projects must be licensed under an Open Source Licence: i.e., any license for the project shall include terms substantially similar to the terms of version 1.9 of the Open Source Definition, promulgated by the Open Source Initiative at https://opensource.org/osd-annotated.
Documentation of solution: how to run, how it works.
Recorded demonstration of working solution.
A working link to a public Github or Gitlab repository containing the code, team members, presentations, demo and documentation, licence information.
This bounty requires a POC or an analysis on how to automate Wikipedia snapshot uploading on Swarm.
Using Swarm as underlying storage: second layer solutions such as Fairdrive / FairOS and Freezr are applicable.

Submission deadline

19th March 2022, 24:00 UTC

Judging Criteria

Meeting the listed requirements.
Compliance with Fair Data Society Principles.
Quality of implementation: code, documentation, technical excellence.
Quality of user experience.
Innovation of implementation and of use case.
Technical complexity of implementation.

Winner Announcement Date

Winner(s) will be announced on 21st March 2022.

gitcoinbot commented 2 years ago

Issue Status: 1. Open 2. Started 3. Submitted 4. Done

Work has been started.

These users each claimed they can complete the work by 48 minutes ago. Please review their action plans below:

1) alexlixandru has started work.

Started working on the project 2) r0qs has started work.

Wikipedia mirror hosted on Swarm. 3) asabya has started work.

upload wikipedia content hosted on swarm and show it on index.html 4) edgarbarrantes has started work.

Progress:

So far this repo contains:

uploader.sh: handles downloading zimtools, the wikipedia zim file, decompressing and compressing files, and calling:
indexCreatory.py: handles the creation of index and error files. The index file has links to all the wikipedia articles. It also makes them html files for webbrowsers to read and handles relative links inside those files.
docker-compose.yml: Currently creating containers of swarm and clef (which might not bee needed) and just a template for the local Dockerfile.
A Dockerfile that will handle the creation of the main image that will handle the communication with the Bee instance.

Next steps:

Work on the Dockerfile and make it talk to the Bee container, I'm planning on using swarm-cli but I might as well just use curl. 5) shepherliu has started work.

wiki mirror based on swarm

Learn more on the Gitcoin Issue Details page.

gitcoinbot commented 2 years ago

Issue Status: 1. Open 2. Started 3. Submitted 4. Done

Work for 5000.0 BZZ (6200.0 USD @ $1.24/BZZ) has been submitted by:

@fairdatasociety-github please take a look at the submitted work:

PR by @r0qs
PR by @tnkrxyz
PR by @asabya
PR by @edgarbarrantes
PR by @shepherliu

Learn more on the Gitcoin Issue Details page
Want to chip in? Add your own contribution here.
Questions? Checkout Gitcoin Help or the Gitcoin's Discord
$4,758,445.84 more funded OSS Work available on the Gitcoin Issue Explorer

gitcoinbot commented 2 years ago

Issue Status: 1. Open 2. Started 3. Submitted 4. Done

The funding of 5000.0 BZZ (2698.59 USD @ $0.54/BZZ) attached to this issue has been approved & issued to @edgarbarrantes.

Learn more on the Gitcoin Issue Details page
Questions? Checkout Gitcoin Help or the Gitcoin's Discord
$3,199,993.18 more funded OSS Work available on the Gitcoin Issue Explorer

fairDataSociety / WAM