search

matomo-org / referrer-spam-list

Community-contributed list of referrer spammers. Comment +1 in any issue or Pull request and the spammer will be added to the list!
https://matomo.org/blog/2015/05/stopping-referrer-spam/
669 stars 301 forks source link

Bulk PR possible? #1072

Closed Zodiac1978 closed 5 years ago

Zodiac1978 commented 5 years ago

Of course I read https://github.com/matomo-org/referrer-spam-blacklist/blob/master/CONTRIBUTING.md but even after applying the current spammer list I have over 400 hundred new spammer in my logs. A little bit too much for single PRs ...

Would it be possible to add those spammers in bulk?

spmedia commented 5 years ago

~400 is a lot to review in a single go. Post the list of URLs here and let me go over it. If it looks good, I can mass merge them.

Zodiac1978 commented 5 years ago 
logo-all.ru
halefa.com
bravica.ru
fartunabest.ru
bravica.online
moonci.ru
vk.com
bravica.biz
bravica.com
bravica.me
bravica.news
bravica.su
olovoley.ru
whoiswho.crimea.ua
bravica.net
bravica.pro
gazel-72.ru
translationcorporation.kiev.ua
td-l-market.ru
mebel-arts.com
diatelier.ru
online-sbank.ru
webalex.pro
pamjatnik.com.ua
carivka.com.ua
makler.org.ua
avtorskoe-vino.ru
03p.info
actualremont.ru
spartania.com.ua
deluxewatch.su
reklamnoe.agency
ellemarket.com
tricolortv-online.com
kipu.crimea.ua
socialmediascanner.eset.com
finder.cool
silvergull.ru
alp-rk.ru
cityreys.ru
xn----7sbabb9a1b7bddgm6a1i.xn--p1ai
potolokelekor.ru
profnastil-moscow.ru
doctornadezhda.ru
moe1.ru
ucanfly.ru
bur-rk.ru
vsdelke.ru
probenzo.com.ua
oooh.pro
sovetogorod.ru
partizan19.ru
xn----8sbbjimdeyfsi.xn--p1ai
pfrf-kabinet.ru
svadba-teplohod.ru
housedesigning.ru
ege-krasnoyarsk.ru
natprof.ru
samchist.ru
holiday-shop.ru
pirelli-matador.ru
allcryptonews.com
clothing-deal.club
pay.ru
stat.lviv.ua
print-technology.ru
lifespeaker.ru
dent-home.ru
podolsk.rev-pro.ru
suzuki-metropolis.kiev.ua
prostoacc.com
dom-international.ru
educhess.ru
1st-urist.ru
yoga4.ru
eraglass.com
yuristproffi.ru
remontvau.ru
ets-2-mod.ru
aviaseller.su
vetbvc.ru
brickmaster.pro
hentai-manga.porn
fazika.ru
ntdtv.ru
vzube.com
wallpapers-all.com
stroyalp.ru
online-akbars.ru
gbh-invest.ru
spravkavspb.work
amos-kids.ru
kruiz-sochi.ru
womensecret.domashniy-recepti.ru
petrushka-restoran.ru
tdbatik.com
holodkovich.com
tesla-audit.ru
bki24.info
xn------6cdbciescapvf0a8bibwx0a1bu.xn--90ais
best-printmsk.ru
the-world.ru
bettorschool.ru
rangjued.com
1kreditzaim.ru
domovozik.ru
mmdoors.ru
dompechey.by
electric-blue-industries.com
yurcons.pro
mhp.su
transit.in.ua
huntdown.info
smt4.ru
nakozhe.com
no-rx.info
krasota-zdorovie.pw
ib-rencredit.ru
fainaidea.com
best-mam.ru
insultu-net.ru
buhproffi.ru
stroy-matrix.ru
kabinet-tele2.ru
kierowca-praca.pl
weightbelts.ru
kabinet-ipoteka-domclick.ru
go.mail.ru
prezidentshop.ru
groshi-kredut.com.ua
arturs.moscow
teman.com.ua
povodok-shop.ru
mamasuper.prom.ua
zapnado.ru
discounttaxi.kz
megalit-d.ru
zt-m.ru
kredutu.com.ua
xn----dtbffp5aagjgfm.xn--p1ai
mksoap.ru
tocan.biz
toposvita.com
ru.toposvita.com
traveller-rays.blogspot.ru
kabinet-vtb24.ru
zdm-auto.ru
bo-vtb24.ru
moisadogorod.ru
boltushkiclub.ru
uruto.ru
domsadiogorod.ru
bonus-spasibo-sberbank.ru
palma-de-sochi.ru
bonus-vtb.ru
mtsguru.ru
enter-unicredit.ru
ib-homecredit.ru
volond.com
uslugi-tatarstan.ru
binokna.ru
uyutmaster73.ru
business-online-sberbank.ru
sign-service.ru
films2018.com
parking-invest.ru
kabinet-5ka.ru
s-luna.me
buildnw.ru
flexderek.com
citybur.ru
lk-lk-rt.ru
xpert.com.ua
kabinet-faberlic.ru
kabinet-gosuslugi.ru
credit-card-tinkoff.ru
online-pochtabank.ru
kabinet-karta-5ka.ru
online-raiffeisen.ru
kabinet-lk-rt.ru
wrc-info.ru
ankerch.crimea.ua
kabinet-nalog.ru
online-vostbank.ru
ledx.by
kabinet-online-bm.ru
dicru.info
magicart.store
xn--80aeb6argv.xn--p1ai
kabinet-online-open.ru
divan-dekor.com.ua
kabinet-online-rsb.ru
zamolotkom.ru
kabinet-online-rshb.ru
dodge-forum.eu
polemikon.ru
svet-depo.ru
medic-al.ru
kabinet-online-sberbank.ru
kabinet-online-sovcombank.ru
xn----8sbowe2akbcd4h.xn--p1ai
mebel-ekb.com
timmy.by
kabinet-pfr.ru
td-abs.ru
kabinet-pfrf.ru
teplokomplex.ru
bez-zabora.ru
kabinet-platon.ru
biz-law.ru
24h.doctor
kabinet-qiwi.ru
alexsander.ch
kabinet-tricolor.ru
drugs-no-rx.info
tiles.services.mozilla.com
blogua.org
carscrim.com
moygorod-online.ru
applepharma.ru
shop.techno-maxi.com.ua
rieltor.crimea.ua
vape-x.ru
sitesadd.com
good-potolok.ru
piratbike.ru
energomash.net
ru-online-sberbank.ru
aworlds.com
es-pfrf.ru
vodabur.by
novosti-avto.ru
stoliar.org
85.13.146.236
i-spare.ru
bonkers.name
a-elita.in.ua
rspectr.com
catterybengal.com
vladtime.ru
chainii.ru
o-promyshlennosti.ru
paulinho.ru
kabinet-alfaclick.ru
obyavka.org.ua
aerotour.ru
pharm--shop.ru
kabinet-esia-gosuslugi.ru
shulepov.ru
agro-gid.com
buypuppies.ca
gatwick.ru
all-news.kz
specstroy36.ru
xn----7sbabhv4abd8aih6bb7k.xn--p1ai
svs-avto.com
leboard.ru
argo-visa.ru
antonovich-design.com.ua
xn--e1aahcgdjkg4aeje6j.kz
dnmetall.ru
medicaltranslate.ru
quickchange.cc
dacha-svoimi-rukami.com
top-instagram.info
room-mebel.ru
thaimassage-slon.ru
e-stroymart.kz
mikrozaim.site
tocan.com.ua
eaptekaplus.ru
sheki-spb.ru
eventiyahall.ru
nicola.top
fashiong.ru
svoimi-rukamy.com
onlinedic.net
oracle-patches.ru
buynorxx.com
webxtrakt.de
okna-systems.pro
cosmediqueresults.com
skidku.org.ua
lotoflotto.ru
dentuled.net
urblog.xyz
ptashkatextil.ua
raschtextil.com.ua
dna-sklad.ru
thelotter.su
alphaopt24.ru
tvfru.org
dvk-stroi.ru
mirfairytale.ru
resurs-2012.ru
mysexpics.ru
galblog.top
samara-comfort.ru
balayazh.com
shoprybalka.ru
brauni.com.ua
videochat.world
ledalfa.by
krasota.ru
polyana-skazok.org.ua
x-lime.net
gezlev.com.ua
lyrics.home-task.com
headpharmacy.com
strady.org.ua
prostitutki-spb.spb.ru
autoservic.by
domashniy-recepti.ru
bestbookclub.ru
recinziireale.com
doxyporno.com
mostcool.top
rql.kiev.ua
gruzchiki24.ru
kollekcioner.ru
krasivoe-hd.net
truebeauty.cc
pageinsider.org
5elementov.ru
samara-airport.com
womandoctor.liffa.ru
paretto.ru
lakiikraski.ru
ukrcargo.com
asupro.com
QIWI.xyz
meriton.ru
msk.prom23.ru
hydra2.market
vkonche.com
hydra-2019.ru
obnallpro.cc
qwant.com
otdyx-s-komfortom.ru
incanto.in.ua
chatroulette.life
kozhakoshek.com
yur-p.ru
online-pharma.ru
popugauka.ru
spy-app.info
timer4web.com
detailedvideos.com
machiavelli.filosoff.org
xn--80aabcsc3bqirlt.xn--p1ai
tam-gde-more.ru
arendadogovor.ru
holistickenko.com
superoboi.com.ua
autofuct.ru
maritain.filosoff.org
dogovorpodryada.ru
syktyvkar.prommebel.net
zot.moscow
bulgaria-web-developers.com
kinolino.nethttp
taganrog.prommebel.net
c-o-pop.de
dommdom.com
results.searchlock.com
meteocast.net
molochnica-stop.liffa.ru
samogonius.ru
redraincine.com
molochnicainfo.liffa.ru
eskei83.com
marinetraffic.com
elegante-vitrage.ru
kemerovo.prommebel.net
toffler.filosoff.org
cnv-kuriere.de
emctestlab.ru
naberezhnie-chelny.prommebel.net
trotsky.filosoff.org
brahma.filosoff.org
netmolochnici.liffa.ru
epicdiving.com
etotupo.ru
buildwithwendy.com
expert-find.ru
izgoev.filosoff.org
otdbiaxaem-vmeste.ru
vseprobrak.ru
vgoloveboli.net
candidos.liffa.ru
okno.ooo
nur-wellnessreisen.de
in-sto.ru
similarmoviesdb.com
abakan.prommebel.net
warmex.com.ua
laotzu.filosoff.org
startgoogle.startpagina.nl
slotron.com
lechimmolochnicy.liffa.ru
volgograd.prommebel.net
sochi.prommebel.net
petrarca.filosoff.org
worldofbtc.com
alcobutik24.com
concretepol.com
plagscan.com

I can make a PR out of it too if helpful.

Zodiac1978 commented 5 years ago

These are spammers from the logs of a German website, so maybe webxtrakt.de could be okay, c-o-pop.de seems to be a serious website and cnv-kuriere.de too.

The rest is mostly Russian spam which has nothing to do with a German website.

skylarmt commented 5 years ago

vk.com is a popular social media site in Russia.

spmedia commented 5 years ago

Closing this as the list is a bit dated and it contains popular sites like vk.ru and urls with subdomains. This list is not properly vetted or reviewed. Please only add root domains into the list.

Zodiac1978 commented 5 years ago

Closing this as the list is a bit dated and it contains popular sites like vk.ru and urls with subdomains. This list is not properly vetted or reviewed. Please only add root domains into the list.

Really? This is the reply to a contributing volunteer? After 8 months of waiting time?

Your first reply was:

Post the list of URLs here and let me go over it.

"let me go over it", but no review from your side. And after 8 months closing because "dated". WTH!?

I really want to help, but this is not welcoming for contributors at all.

And you really dismiss 99% spam domains because there are a few popular sites or sites with subdomains? You could have asked for cleaning, but you closed the issue ...

I am not sure if I will contribute here again. :(

spmedia commented 5 years ago

Hi,

I closed the issue because the list has become so dated now (8 mo). I should have replied to this Issue sooner, my apologies.

If you clean the list of non-spam domains and IPs (vk.com, tiles.services.mozilla.com(!), 85.13.146.236, etc.), subdomains, dedupe against current list, and reopen as a PR instead of an issue, it can be reviewed and considered for a merge.

Thanks!