mixflame / GlobalChat2

real-time, low bandwidth, game-like global channel chat for enterprise with persisted, automated scrollback of logs and multiline pasting support. attempt to make long overlooked improvements on IRC technology by inventing a new, simpler, controllable one.
GNU General Public License v3.0
2 stars 0 forks source link

A method for filtering objectionable content #104

Closed mixflame closed 4 years ago

mixflame commented 4 years ago

-WebPurify-or-voting-system-

mixflame commented 4 years ago

Domain based URL whitelist (top 500 sites to start) and content blacklist filter based at Fauna DB and Netlify (msl-poc)

mixflame commented 4 years ago
"Rank","Root Domain","Linking Root Domains","Domain Authority"
"1","apple.com","4,609,840","100"
"2","www.google.com","12,139,080","100"
"3","youtube.com","17,809,946","100"
"4","www.blogger.com","25,266,369","99"
"5","docs.google.com","2,272,303","99"
"6","microsoft.com","4,591,732","99"
"7","support.google.com","4,589,668","99"
"8","play.google.com","2,386,724","99"
"9","adobe.com","2,864,805","98"
"10","maps.google.com","4,390,290","98"
"11","en.wikipedia.org","5,492,462","98"
"12","cloudflare.com","5,238,666","98"
"13","linkedin.com","8,884,660","98"
"14","wordpress.org","9,953,066","98"
"15","plus.google.com","11,840,019","98"
"16","accounts.google.com","2,534,373","97"
"17","vimeo.com","3,124,852","97"
"18","europa.eu","1,691,160","97"
"19","googleusercontent.com","2,162,642","97"
"20","drive.google.com","1,797,039","97"
"21","mozilla.org","1,963,058","97"
"22","sites.google.com","1,692,936","97"
"23","youtu.be","3,950,464","97"
"24","medium.com","1,135,648","96"
"25","bbc.co.uk","1,424,316","96"
"26","facebook.com","45,635,134","96"
"27","bp.blogspot.com","15,967,493","96"
"28","amazon.com","4,024,819","96"
"29","line.me","604,438","96"
"30","github.com","2,022,763","96"
"31","es.wikipedia.org","779,870","96"
"32","vk.com","1,592,597","96"
"33","creativecommons.org","1,553,888","96"
"34","istockphoto.com","3,091,231","96"
"35","theguardian.com","1,205,761","95"
"36","whatsapp.com","1,775,625","95"
"37","google.fr","382,797","95"
"38","policies.google.com","1,123,789","95"
"39","forbes.com","1,146,687","95"
"40","nytimes.com","1,696,491","95"
"41","developers.google.com","911,821","95"
"42","wikimedia.org","1,372,757","95"
"43","feedburner.com","1,736,645","95"
"44","photos.google.com","232,206","95"
"45","aliexpress.com","440,373","95"
"46","dropbox.com","940,003","95"
"47","gstatic.com","585,384","95"
"48","t.me","521,485","95"
"49","get.google.com","574,796","95"
"50","who.int","2,100,059","95"
"51","paypal.com","912,317","95"
"52","uol.com.br","562,553","95"
"53","fr.wikipedia.org","541,797","95"
"54","bbc.com","677,206","95"
"55","www.yahoo.com","912,378","95"
"56","msn.com","990,284","95"
"57","cnn.com","1,233,073","95"
"58","pt.wikipedia.org","359,231","95"
"59","google.es","415,050","95"
"60","w3.org","1,064,074","95"
"61","mail.google.com","440,308","95"
"62","dailymotion.com","1,070,341","95"
"63","jimdofree.com","1,657,991","95"
"64","google.de","1,093,536","95"
"65","imdb.com","1,233,071","95"
"66","nih.gov","1,062,643","95"
"67","buydomains.com","1,144,227","95"
"68","hugedomains.com","5,020,508","95"
"69","mail.ru","478,781","95"
"70","globo.com","384,937","95"
"71","reuters.com","735,505","95"
"72","google.co.uk","544,284","95"
"73","live.com","737,883","95"
"74","news.google.com","688,343","95"
"75","myspace.com","1,254,141","95"
"76","google.co.jp","631,195","95"
"77","google.com.br","264,395","95"
"78","slideshare.net","877,699","95"
"79","issuu.com","846,025","94"
"80","ig.com.br","132,866","94"
"81","businessinsider.com","582,405","94"
"82","translate.google.com","276,047","94"
"83","thesun.co.uk","257,311","94"
"84","office.com","351,906","94"
"85","wikia.com","461,150","94"
"86","webmd.com","552,715","94"
"87","cpanel.com","1,259,631","94"
"88","amazon.co.uk","632,109","94"
"89","hatena.ne.jp","1,457,191","94"
"90","telegraph.co.uk","779,139","94"
"91","ft.com","355,297","94"
"92","lefigaro.fr","184,517","94"
"93","pinterest.com","7,192,777","94"
"94","picasa.google.com","248,402","94"
"95","themeforest.net","507,178","94"
"96","foxnews.com","456,101","94"
"97","networkadvertising.org","704,240","94"
"98","www.wix.com","899,373","94"
"99","usatoday.com","640,468","94"
"100","scribd.com","653,974","94"
"101","archive.org","884,858","94"
"102","de.wikipedia.org","595,242","94"
"103","washingtonpost.com","877,109","94"
"104","myaccount.google.com","265,568","94"
"105","google.ru","173,265","94"
"106","wired.com","539,645","94"
"107","fb.com","357,586","94"
"108","tinyurl.com","1,232,851","94"
"109","independent.co.uk","524,122","94"
"110","aol.com","655,902","94"
"111","terra.com.br","186,892","94"
"112","files.wordpress.com","1,990,757","94"
"113","dan.com","1,505,547","94"
"114","www.gov.uk","489,975","94"
"115","dailymail.co.uk","783,592","94"
"116","mediafire.com","765,663","94"
"117","picasaweb.google.com","613,340","94"
"118","abcnews.go.com","476,808","94"
"119","ipv4.google.com","352,903","94"
"120","change.org","402,642","94"
"121","namecheap.com","844,061","94"
"122","search.google.com","973,660","94"
"123","amazon.de","494,237","94"
"124","plesk.com","700,070","94"
"125","cdc.gov","665,290","94"
"126","code.google.com","322,657","94"
"127","ok.ru","329,190","94"
"128","android.com","266,321","94"
"129","bloomberg.com","680,571","94"
"130","mirror.co.uk","259,574","94"
"131","time.com","619,603","94"
"132","bing.com","891,755","94"
"133","aboutads.info","491,945","94"
"134","marketingplatform.google.com","753,070","94"
"135","privacyshield.gov","423,024","94"
"136","youronlinechoices.com","513,782","94"
"137","twitter.com","48,363,742","94"
"138","books.google.com","348,330","94"
"139","google.it","410,895","94"
"140","gravatar.com","1,787,307","94"
"141","nasa.gov","554,044","94"
"142","telegram.me","272,387","94"
"143","fandom.com","430,092","94"
"144","wsj.com","808,488","94"
"145","abril.com.br","226,900","94"
"146","samsung.com","307,454","94"
"147","amazon.co.jp","774,612","94"
"148","elpais.com","326,517","94"
"149","draft.blogger.com","8,746,798","94"
"150","cnet.com","552,486","94"
"151","rakuten.co.jp","587,635","94"
"152","id.wikipedia.org","410,466","94"
"153","tools.google.com","1,508,251","94"
"154","goo.gl","4,195,675","94"
"155","steampowered.com","218,627","94"
"156","sedo.com","2,468,675","94"
"157","bit.ly","4,057,453","94"
"158","news.yahoo.com","575,706","94"
"159","rt.com","232,423","94"
"160","un.org","424,271","94"
"161","ebay.com","874,946","94"
"162","huffingtonpost.com","881,235","94"
"163","booking.com","354,914","94"
"164","opera.com","760,876","94"
"165","harvard.edu","592,191","94"
"166","cpanel.net","1,346,881","94"
"167","yahoo.co.jp","621,826","93"
"168","ovh.com","409,671","93"
"169","britannica.com","271,595","93"
"170","groups.google.com","301,159","93"
"171","nokia.com","159,857","93"
"172","buzzfeed.com","449,586","93"
"173","nhk.or.jp","207,151","93"
"174","techcrunch.com","395,557","93"
"175","secureserver.net","912,154","93"
"176","hp.com","393,089","93"
"177","npr.org","603,022","93"
"178","instructables.com","274,419","93"
"179","kickstarter.com","407,611","93"
"180","playstation.com","182,110","93"
"181","ietf.org","354,165","93"
"182","columbia.edu","277,889","93"
"183","finance.yahoo.com","373,098","93"
"184","latimes.com","580,778","93"
"185","google.nl","217,614","93"
"186","amazon.es","146,094","93"
"187","oup.com","316,663","93"
"188","ted.com","482,504","93"
"189","my.yahoo.com","1,133,990","93"
"190","enable-javascript.com","975,284","93"
"191","stackoverflow.com","285,481","93"
"192","loc.gov","372,808","93"
"193","netvibes.com","1,150,659","93"
"194","lemonde.fr","225,747","93"
"195","bloglovin.com","443,747","93"
"196","list-manage.com","621,626","93"
"197","google.com.tw","125,656","93"
"198","economist.com","306,397","93"
"199","wp.com","919,804","93"
"200","ovh.net","718,176","93"
"201","imageshack.us","785,729","93"
"202","newsweek.com","247,995","93"
"203","umich.edu","295,891","93"
"204","ibm.com","441,593","93"
"205","depositfiles.com","140,202","93"
"206","m.wikipedia.org","230,635","93"
"207","bandcamp.com","510,203","93"
"208","walmart.com","268,111","93"
"209","ign.com","233,086","93"
"210","rapidshare.com","281,806","93"
"211","abc.net.au","326,658","93"
"212","elmundo.es","193,253","93"
"213","ggpht.com","573,520","93"
"214","over-blog-kiwi.com","158,087","93"
"215","pixabay.com","301,137","93"
"216","yandex.ru","912,580","93"
"217","researchgate.net","323,518","93"
"218","instagram.com","20,610,428","93"
"219","hm.com","154,899","93"
"220","dw.com","222,730","93"
"221","hollywoodreporter.com","216,978","93"
"222","pexels.com","145,592","93"
"223","addtoany.com","709,149","93"
"224","biglobe.ne.jp","223,902","93"
"225","addthis.com","697,807","93"
"226","trustpilot.com","322,565","93"
"227","goo.ne.jp","298,360","93"
"228","forms.gle","343,491","93"
"229","quora.com","308,233","93"
"230","nginx.org","554,445","93"
"231","gizmodo.com","342,189","93"
"232","yale.edu","281,236","93"
"233","weibo.com","1,495,256","93"
"234","nypost.com","292,887","93"
"235","scoop.it","337,987","93"
"236","shutterstock.com","251,471","93"
"237","news.com.au","254,240","93"
"238","mozilla.com","199,380","93"
"239","noaa.gov","284,880","93"
"240","disqus.com","920,527","93"
"241","php.net","626,335","93"
"242","bp2.blogger.com","522,039","93"
"243","000webhost.com","281,412","93"
"244","guardian.co.uk","522,550","93"
"245","google.co.in","243,437","93"
"246","lg.com","120,747","93"
"247","windowsphone.com","122,969","93"
"248","storage.googleapis.com","456,647","93"
"249","ria.ru","154,936","93"
"250","netflix.com","247,331","93"
"251","gnu.org","571,320","93"
"252","unesco.org","256,430","93"
"253","cbsnews.com","431,639","93"
"254","orkut.com.br","120,048","93"
"255","abc.es","158,047","93"
"256","imageshack.com","434,869","93"
"257","sapo.pt","206,250","93"
"258","ytimg.com","248,141","93"
"259","vice.com","305,579","93"
"260","usnews.com","327,470","93"
"261","psychologytoday.com","275,972","93"
"262","www.livejournal.com","3,033,987","93"
"263","mega.nz","152,204","93"
"264","alibaba.com","370,273","93"
"265","ovh.co.uk","570,426","93"
"266","yelp.com","809,510","93"
"267","amazon.fr","219,888","93"
"268","gofundme.com","275,724","93"
"269","deezer.com","125,949","93"
"270","cornell.edu","371,211","93"
"271","pl.wikipedia.org","129,379","93"
"272","naver.jp","129,917","93"
"273","4shared.com","507,171","93"
"274","fastcompany.com","257,948","93"
"275","apache.org","892,808","93"
"276","cisco.com","209,065","93"
"277","metro.co.uk","177,620","93"
"278","welt.de","159,902","93"
"279","asus.com","140,622","93"
"280","disney.com","212,163","93"
"281","eventbrite.com","543,559","93"
"282","wikihow.com","350,603","93"
"283","stanford.edu","513,789","93"
"284","rambler.ru","229,867","93"
"285","spiegel.de","265,909","93"
"286","nydailynews.com","304,206","93"
"287","espn.com","299,976","93"
"288","nikkei.com","189,776","93"
"289","tes.com","399,135","93"
"290","doubleclick.net","647,302","93"
"291","ja.wikipedia.org","329,729","93"
"292","express.co.uk","206,166","93"
"293","marriott.com","331,275","93"
"294","naver.com","420,581","93"
"295","google.co.id","135,364","93"
"296","bt.com","173,886","93"
"297","princeton.edu","283,390","93"
"298","shopify.com","1,234,204","93"
"299","twitch.tv","301,466","93"
"300","digg.com","816,630","93"
"301","nvidia.com","147,187","93"
"302","cambridge.org","224,028","93"
"303","mysql.com","406,222","93"
"304","mit.edu","572,467","93"
"305","t.co","1,708,542","93"
"306","ru.wikipedia.org","354,932","93"
"307","sciencedirect.com","426,154","93"
"308","ea.com","158,769","93"
"309","engadget.com","401,147","93"
"310","ikea.com","265,361","93"
"311","qq.com","4,183,195","93"
"312","academia.edu","285,631","93"
"313","bitly.com","309,293","93"
"314","pbs.org","424,988","93"
"315","sciencemag.org","268,315","93"
"316","soundcloud.com","1,568,993","93"
"317","google.pl","189,189","93"
"318","blackberry.com","135,494","93"
"319","photobucket.com","1,577,339","93"
"320","smh.com.au","264,531","93"
"321","tripadvisor.com","449,695","93"
"322","mystrikingly.com","253,576","93"
"323","surveymonkey.com","385,390","93"
"324","oracle.com","529,925","93"
"325","www.over-blog.com","615,480","93"
"326","nbcnews.com","308,900","93"
"327","yadi.sk","172,131","93"
"328","wiley.com","441,932","93"
"329","it.wikipedia.org","285,462","93"
"330","nationalgeographic.com","535,593","93"
"331","wa.me","428,625","93"
"332","standard.co.uk","146,790","93"
"333","e-recht24.de","446,385","93"
"334","mashable.com","345,215","93"
"335","berkeley.edu","391,576","93"
"336","www.weebly.com","334,951","93"
"337","indiatimes.com","337,456","93"
"338","iubenda.com","183,969","93"
"339","goodreads.com","671,843","93"
"340","vox.com","380,644","93"
"341","box.com","233,080","93"
"342","akamaihd.net","413,535","93"
"343","whitehouse.gov","318,069","93"
"344","nginx.com","468,488","93"
"345","ox.ac.uk","221,990","93"
"346","worldbank.org","205,990","93"
"347","cbc.ca","350,949","93"
"348","spotify.com","1,120,314","93"
"349","gmail.com","182,389","93"
"350","huffpost.com","418,699","93"
"351","xbox.com","146,080","93"
"352","thetimes.co.uk","300,046","93"
"353","dell.com","210,016","93"
"354","detik.com","349,344","93"
"355","zendesk.com","446,035","93"
"356","icann.org","398,905","93"
"357","utexas.edu","234,003","93"
"358","a8.net","423,619","93"
"359","rtve.es","143,480","93"
"360","amazon.it","126,527","93"
"361","theatlantic.com","428,594","93"
"362","nature.com","446,911","93"
"363","google.ca","293,890","93"
"364","washington.edu","311,618","93"
"365","channel4.com","144,638","93"
"366","cnbc.com","401,636","93"
"367","adssettings.google.com","303,631","93"
"368","godaddy.com","2,318,306","93"
"369","bp1.blogger.com","521,734","93"
"370","bp0.blogger.com","521,745","93"
"371","sendspace.com","150,293","93"
"372","www.wikipedia.org","527,153","93"
"373","fifa.com","143,550","93"
"374","theverge.com","305,545","93"
"375","sciencedaily.com","291,953","93"
"376","about.com","672,643","93"
"377","sfgate.com","319,703","93"
"378","sputniknews.com","137,189","93"
"379","target.com","228,532","93"
"380","variety.com","201,293","93"
"381","googleblog.com","216,911","93"
"382","urbandictionary.com","207,840","93"
"383","discovery.com","221,837","92"
"384","vchecks.me","218,219","92"
"385","businesswire.com","232,425","92"
"386","ca.gov","377,964","92"
"387","arstechnica.com","212,377","92"
"388","allaboutcookies.org","346,934","92"
"389","pastebin.com","171,526","92"
"390","entrepreneur.com","220,606","92"
"391","ucla.edu","229,856","92"
"392","tmz.com","178,492","92"
"393","skype.com","362,888","92"
"394","www.canalblog.com","391,280","92"
"395","dreniq.com","337,564","92"
"396","softonic.com","133,793","92"
"397","asahi.com","163,618","92"
"398","autodesk.com","126,889","92"
"399","cocolog-nifty.com","183,093","92"
"400","thehill.com","172,551","92"
"401","sakura.ne.jp","364,408","92"
"402","answers.yahoo.com","187,262","92"
"403","photos1.blogger.com","820,965","92"
"404","nps.gov","294,866","92"
"405","home.pl","201,647","92"
"406","storage.canalblog.com","276,835","92"
"407","coursera.org","138,078","92"
"408","vkontakte.ru","376,528","92"
"409","people.com","197,602","92"
"410","video.google.com","203,957","92"
"411","eff.org","137,574","92"
"412","about.me","277,679","92"
"413","stores.jp","407,715","92"
"414","steamcommunity.com","182,263","92"
"415","canva.com","132,925","92"
"416","adweek.com","163,369","92"
"417","nifty.com","214,414","92"
"418","e-monsite.com","141,541","92"
"419","medicalnewstoday.com","175,630","92"
"420","lego.com","121,622","92"
"421","home.neustar","435,944","92"
"422","etsy.com","1,499,407","92"
"423","answers.com","217,015","92"
"424","snapchat.com","157,540","92"
"425","oreilly.com","222,627","92"
"426","bp3.blogger.com","521,979","92"
"427","rediff.com","267,687","92"
"428","tabelog.com","140,597","92"
"429","mayoclinic.org","277,067","92"
"430","calendar.google.com","138,563","92"
"431","offset.com","776,697","92"
"432","imgur.com","1,126,460","92"
"433","dictionary.com","239,159","92"
"434","ameblo.jp","736,891","92"
"435","usgs.gov","196,910","92"
"436","lonelyplanet.com","152,556","92"
"437","interia.pl","159,266","92"
"438","nba.com","181,055","92"
"439","amazon.ca","177,801","92"
"440","theglobeandmail.com","221,433","92"
"441","ssl-images-amazon.com","157,384","92"
"442","boston.com","278,574","92"
"443","weather.com","213,457","92"
"444","outlook.com","195,017","92"
"445","lycos.com","687,011","92"
"446","springer.com","349,356","92"
"447","ebay.co.uk","204,729","92"
"448","histats.com","451,269","92"
"449","foursquare.com","235,574","92"
"450","mixcloud.com","172,333","92"
"451","slate.com","309,437","92"
"452","gutenberg.org","159,852","92"
"453","indiegogo.com","217,802","92"
"454","venturebeat.com","181,239","92"
"455","megaupload.com","244,232","92"
"456","afternic.com","1,345,244","92"
"457","ed.gov","237,495","92"
"458","ucoz.ru","183,305","92"
"459","chron.com","196,312","92"
"460","zdnet.com","244,047","92"
"461","plos.org","222,747","92"
"462","weforum.org","151,021","92"
"463","billboard.com","165,832","92"
"464","chinadaily.com.cn","276,053","92"
"465","ibtimes.com","158,780","92"
"466","thestar.com","185,519","92"
"467","businessinsider.com.au","253,217","92"
"468","huawei.com","126,385","92"
"469","history.com","189,948","92"
"470","uber.com","121,803","92"
"471","google.com.au","184,648","92"
"472","dreamstime.com","131,884","92"
"473","corriere.it","143,854","92"
"474","geocities.jp","243,602","92"
"475","inc.com","209,527","92"
"476","upenn.edu","265,086","92"
"477","thoughtco.com","294,892","92"
"478","arxiv.org","179,944","92"
"479","si.edu","232,415","92"
"480","wattpad.com","195,159","92"
"481","clickbank.net","438,737","92"
"482","groups.yahoo.com","302,933","92"
"483","irs.gov","252,618","92"
"484","apnews.com","179,260","92"
"485","house.gov","232,327","92"
"486","eonline.com","176,150","92"
"487","xing.com","406,216","92"
"488","axs.com","223,917","92"
"489","mhlw.go.jp","139,633","92"
"490","ehow.com","229,597","92"
"491","chicagotribune.com","299,989","92"
"492","thenextweb.com","169,846","92"
"493","fda.gov","282,002","92"
"494","gesetze-im-internet.de","136,242","92"
"495","newscientist.com","193,491","92"
"496","khanacademy.org","149,014","92"
"497","thedailybeast.com","205,398","92"
"498","gamespot.com","180,314","92"
"499","amzn.to","714,384","92"
"500","ftc.gov","215,887","92"
mixflame commented 4 years ago

Method to request url be whitelisted in app

mixflame commented 4 years ago

This is done with Linksafe.cr and Obscenity-cr