ipfs-inactive / archives

[ARCHIVED] Repo to coordinate archival efforts with IPFS
https://awesome.ipfs.io/datasets
183 stars 24 forks source link

Repressed News Outlets in the Middle East #153

Open simplymathematics opened 7 years ago

simplymathematics commented 7 years ago

Aljazeera.com kurdishnews.com hawarnews.com madamasr.com www.huffingtonpost.com/topic/arabic

whyrusleeping commented 7 years ago

@meyerscr what would the best way to mirror these sites be? If you can help us define a process for easily archiving this, we can definitely get it pinned :)

simplymathematics commented 7 years ago

Working on it! I think I can get static html dumps of the smaller sites.

Also, include: firatnews.com gazettesujin.com etha.com.tr dihaber.org bianet.org

What about a central link with all the censored content, other than the ipfs.io link? Found a mobile developer who could slap together a google app engine redirector that can't be blocked in case they go after the URL.

aljazeera, madamasr, and huffingtonpost are banned in Egypt. The rest are banned in Turkey.

simplymathematics commented 7 years ago

Then, the big one is twitter, but I've explained that that is out of the capability of this app and ipfs. Stupid dynamic content.

brannondorsey commented 7 years ago

Are y'all familiar with the ArchiveTeam's NewsGrabber project (code here)? They might have some code you could re-use. Hell they would probably be able to make their full archives accessible via ipfs.

iuriguilherme commented 7 years ago

Twitter can actually be mirrored on demand via a bot API. But that would require specifying accounts to follow and archive.

PS: Indeed, non archiving oriented websites are just stupid.