citizenlab / test-lists

URL testing lists intended for discovering website censorship
456 stars 344 forks source link

Removed duplicate URLs from various country lists #1825

Closed RandomGuy48 closed 1 month ago

RandomGuy48 commented 1 month ago

Updated www.heritage.org, www.imf.org, www.unfpa.org and www.worldbank.org into https

Duplicates of https://www.heritage.org/

Duplicates of https://www.imf.org/

Duplicates of https://www.unfpa.org/

Duplicates of https://www.worldbank.org/

Duplicates of https://www.aljazeera.net/ and https://www.aljazeera.com/ - #510

Duplicate of https://www.haaretz.com/

Duplicates of https://www.ohchr.org/

Duplicates of https://en.wikipedia.org/

Additionally, I removed https://www.unwomen.org/en/news/stories?topic=f8c6fb042b184dd482c36bf10173a6aa image

RandomGuy48 commented 1 month ago

Incidentally, I found these YouTube channel by AlJazeera in ph.csv and sa.csv when I was removing duplicate links:

Should we also remove it or keep it?

sloncocs commented 1 month ago

thanks so much! ❤️

sloncocs commented 1 month ago

I think we can remove the YouTube channel too.