List of News Sources

[lintangsutawika]

Similar to #17

• [x] ProPublica
• [x] DemocracyNow
• [x] The Conversation
• [x] Agência Pública
• [x] OpenDemocracy
• [ ] Tasnim
• [x] Mongabay

CC BY

• [ ] 360info
• [ ] Meduza
• [ ] Alt News
• [ ] SciDev.Net
• [ ] Agenzia Fides
• [ ] Factly
• [ ] Milwaukee Neighborhood News Service
• [ ] Global Voices
• [ ] Tasnim News Agency
• [ ] Mekong Eye
• [ ] Africa is a Country
• [ ] Balkan Diskurs
• [ ] Minority Africa
• [ ] PanARMENIAN.Net
• [ ] ZimFact
• [ ] The Solutions Journalism Exchange
• [ ] Freedom of the Press Foundation
• [ ] New Canadian Media
• [ ] Project Multatuli

CC BY-SA

• [ ] Propastop
• [ ] The Public Record
• [ ] EduCeleb
• [ ] Liberty TV
• [ ] Oxpeckers

Public Domain

• [ ] Voice of America
• [ ] Caravanserai

[lintangsutawika]

https://wiki.creativecommons.org/wiki/journalism

[StellaAthena]

MOT corpus is very small (35M tokens of English, less than 1B tokens total) but worth mentioning for completeness

[lintangsutawika]

ProPublica, DemocracyNow, and The Conversation use CC BY-NC-ND 3.0 Agência Pública and Mongabay use CC BY-ND Tasnim uses CC BY 4.0 OpenDemocray only says it uses CC

@StellaAthena

[StellaAthena]

@lintangsutawika OpenDemocracy is CC-BY-NC if you go look at the individual articles.

So it seems that Tasnim is the only source that has a sufficiently permissive license.

[lintangsutawika]

That's too bad, hoping to balance Tasnim with news source biased towards its opposite. Without news sites, it would be hard to train a model with current/recent events.

[lintangsutawika]

Found a site that indexes news and also has tags on what specific CC License they use. https://opennewswire.org/feed/