ipfs / distributed-wikipedia-mirror

Putting Wikipedia Snapshots on IPFS
https://github.com/ipfs/distributed-wikipedia-mirror#readme
632 stars 54 forks source link

Wikipedia Mirror for Afghanistan #100

Closed kelson42 closed 3 years ago

kelson42 commented 3 years ago

Following https://twitter.com/AlexHinojo/status/1426902378020843522

kelson42 commented 3 years ago

It seems there is no Wikipedia in Dari, see https://en.wikipedia.org/wiki/Dari. But it might be worth to make the one in Farsi instead. ZIM file is available at https://download.kiwix.org/zim/wikipedia_fa_all.zim.

Wikipedia ZIM file in Pasto is available at https://download.kiwix.org/zim/wikipedia_ps_all.zim.

arky commented 3 years ago

We never got enough momentum with Dari(prs) contributions in most open source community projects.

lidel commented 3 years ago

Sadly the build is broken again (confirmed that it is not specific to pa, latest my is also broken, most likely other ones too). I am running fa now, but it will take a bit more time to confirm.

Filled https://github.com/ipfs/distributed-wikipedia-mirror/issues/101 (my) and https://github.com/ipfs/distributed-wikipedia-mirror/issues/102 (pa) with more details.

Note: I am unable to sink more time into fixing ZIM unpacking and publishing. It took too long last time (weeks!), engineering overhead is not sustainable imo.

:point_right: We really need to figure out web-based reader and use original ZIMs (remove the need for unpacking and manual customization)

lidel commented 3 years ago

That being said, I was able to build fa from wikipedia_fa_all_maxi_2021-06.zim and here we were lucky: it seems to mostly work:

I looked into this and "Dari" is official name for "Afghan Persian". According to https://en.wikipedia.org/wiki/Dari delivering Farsi wiki most likely provides the best value here:

Apart from a few basics of vocabulary, there is little difference between formal written Persian of Afghanistan and of Iran.

lidel commented 3 years ago

DNSLink at https://fa.wikipedia-on-ipfs.org/wiki/ should be working.

@arky @kelson42 it is ok to share the above link, or encourage people to install Brave and open ipfs://bafybeicpnshmz7lhp5vcowscty4v4br33cjv22nhhqestavb2mww6zbswm if DNS is censored.

(The PR https://github.com/ipfs/distributed-wikipedia-mirror/pull/103 will be merged when I get a confirmation that is pinned outside my machine.)

arky commented 3 years ago

Yes, Please \o/

Kudos @lidel @kelson42