krystian3w
commented
4 years ago fyi @Yuki2718
Closed DandelionSprout closed 4 years ago
krystian3w
commented
4 years ago fyi @Yuki2718
Yuki2718
commented
4 years ago @DandelionSprout Thank you for your effort to improve JP filter, this has long been in my mind but indeed reporting one by one is impossible. While official AG team is inactive on weekends I'll double-check them so that the team can save their time. @krystian3w Thx for letting me know.
BTW I've been in preparation for a JP filter dedicated for uBO which takes a peculiar situation in Japanese adblock user into account that they unsubscribe default lists and keep only a Japanese list. This causes a vicious spiral that 1. problems by default lists not reported <-> 2. people not using default lists as problems are not sorted out.
Yuki2718
commented
4 years ago Okay here's my revision of the suggested rules with comments.
! ---------- Revised version ----------
! made more specific to avoid potential FP
||cloudfront.net/images/banner/250_50_$domain=zaif.jp
zaif.jp###banner_head
zaif.jp##.banner-kv
! I don't see adcontents.primead.jp and instead see different subdomains.
! Once primead is blocked, ##.aa_ad-home-thumb-small is not needed.
||primead.jp^
! switched to standard selector for maximum compatibility
mixi.jp##.COMMUNITY_bodyArea__subArea > .adBanner:first-child + .COMMUNITY_rightAreaBox
daily.co.jp##.pnl-aside
daily.co.jp##.recommend
! to cover their video ads too
||adp.homes.co.jp^
homes.co.jp##.adPremium
2nn.jp##.ads
||jorudan.co.jp/com/img/bnr/w685_
hatenablog.com##.serviceTop-recommend-ad
! e.g. http://shioring78.hatenablog.com/entry/2020/07/03/191802
##.google-afc-image
! e.g. http://ejo090.hatenadiary.jp/ may be generic?
hateblo.jp,hatenablog.com,hatenablog.jp,hatenadiary.com,hatenadiary.jp,hatenadiary.org##.sleeping-ads
firestorage.jp###mains > .minispace2
! https://weathernews.jp/s/topics/202006/160115/
||smtgvs.weathernews.jp/s/topics/img/banner/
weathernews.jp#?#.block:has([id^=div-gpt-ad])
weathernews.jp#?#.block:has(script[src$="/yads.js"])
allabout.co.jp##.js-ui-top-banner-animation
allabout.co.jp##.aa_rec-box
ascii.jp##.ad
! Anti-adblock
||diamond.jp/go/pb/forbrave/
diamond.jp###dol17_article_recm_pc
diamond.jp##.pr-icon
diamond.jp##.pr-icon + .top-article
diamond.jp##.sub-trend-watch
infoseek.co.jp###bannerblock
mainichi.jp###main > .no-print
mainichi.jp##.apply-link + .ad
mainichi.jp##.article .ad
||api.primecaster.net^
||gmossp-sp.jp^
tenki.jp##div[class^=tenki-ad-]
||genieedmp.com^
wowkorea.jp##div[style="width:300px;height:250px;"]
alc.co.jp###news > ul
alc.co.jp###container > div[style^="width:1100px; "]
! https://eow.alc.co.jp/
eow.alc.co.jp##.ad_left
eow.alc.co.jp##.five
atwiki.jp###ads
! https://w.atwiki.jp/gcmatome/pages/4006.html
atwiki.jp###google_relate_ads
! The 2nd rule in Nano now doesn't match, the last "S" must be capital letter.
picrew.me##.imagemaker_ad_wrapper
picrew.me##.search-Sidebar
! Only after you finished a game.
picrew.me##.c_related_section:first-of-type
tinami.com###main > .eventmesh + .text
poipiku.com##.SideBarMid
min.dododori.com###fix-space
! Ad scripts
||nikkei.jp^*/f1h_text1.js|
||partsa.nikkei.com/static/nkis/js/foneH.js
! .k-ad has more hits than .k-ad__text but probably the latter is enough.
www.nikkei.com##.PRb
www.nikkei.com##.k-ad__text
www.nikkei.com##.k-hub-pr
www.nikkei.com##.newsTrendWatch
asia.nikkei.com##.article__footer:last-child
businessinsider.jp##.f-content-secondary > style + div
businessinsider.jp##.p-post-content > div > p:first-child
lifehacker.jp##.lh-banner
sankei.com#?#.row:has(div[id^="div-gpt-ad-"])
nicoco.net###search_form_wrap > div
5ch.net###banner
shindanmaker.com###sm_pc_head_728x90_bl
www.weblio.jp###adPcBnrWrp
www.weblio.jp##.ads-loader
www.weblio.jp##.firstDictBnr
www.weblio.jp##.rectangle-ads-frame-www
! Rules are independent so no need to convert standard selector to extended ones;
! Platforms not supporiting extended syntax just can't hide some placeholders.
ejje.weblio.jp###footFixBar
ejje.weblio.jp#?#.mainBlock:has(.flex-rectangle-ads-frame)
ejje.weblio.jp#?#.sideBlock:has([id$=AdId])
uwl.weblio.jp#$##side { display: none !important; }
uwl.weblio.jp#$##main { width: 1325px !important; padding-left: 15px !important; }
uwagakisimasuka.blog.fc2.com#?#.side_plugin:has(.adsbygoogle)
momoniji.com###content-top-in > .widget-content-top:first-child
momoniji.com#?#.widget_pc_text:has(script[src^="https://ad-nex."])
! I suggest the below for Mobile ads filter
momoniji.com#?#.widget_mobile_text:has(script)
! https://seiga.nicovideo.jp/comic/47103?track=top_pickup
seiga.nicovideo.jp##.level_ad
! better coverage
toranoana.jp##.tora-ads-default
! block brogroll craps too
||file.dousyoko.net/uploads/$subdocument
dousyoko.net##.floatbox1
dousyoko.net##.floatbox2
dousyoko.net##.plugin2_outline
dousyoko.net##.plugin3_outline
||file.buhidoh.net/uploads/$subdocument
buhidoh.net###center-left > .plugin3_outline
buhidoh.net###center-left > .plugin3box
buhidoh.net###right > .plugin2_outline:last-child
buhidoh.net###text-3
! just for better looking
buhidoh.net#$##center-left { height: auto !important; }
! This on http://anime.eroterest.net/ can be safely blocked.
||okbp.xyz^
h723.blog.fc2.com##div[align="left"]
h723.blog.fc2.com##div[align="left"] + div[style]
h723.blog.fc2.com##.plugin1_outline:first-of-type
h723.blog.fc2.com##.plugin1_outline:nth-of-type(n+3)
! hotpress.info looks like a Chinese site
! uBlock filters blocks pornimg.xyz but I'm not sure if it's not FP here.
! OTOH 53orz.com, a Chinese porn site, should be blocked at least on this domain.
! Currently neither of EL China or CJX blocks this.
||53orz.com^$domain=hotpress.info
! Anti ad-block
hotpress.info#%#//scriptlet('prevent-setTimeout', 'nextFunction', '2000')
! I prefer hotpress.info##.widget_text:has(script) but prioritized compatibility.
hotpress.info##.widget_text:first-child
hotpress.info##.widget_text:nth-of-type(n+5)
! ---------- No more needed ----------
! Can DandelionSprout report back to Nano-contrib about rules taken from it?
allabout.co.jp##.aa_ad-home-thumb-small
allabout.co.jp##div[id^=pa_placement_]
! added to EL
jorudan.co.jp###Ads_google_bottom_wide
! couldn't find
||prd-static-cdn.tver.jp/web/TEAD_banner^$subdocument
###ADoverlay
! $generichide is in uBlock Annoyances and no more needed; will report it
atwiki.jp##.adsbygoogle
9ketsuki.info###sougo_rss
picrew.me##.search_imagemaker_list_ad
! Added to EL
poipiku.com##.PcSideBarAd
! works but is it really needed?
min.dododori.com#$#footer {padding-bottom: 10px !important;}
! blog.goo.ne.jp is a popular blog service used by millions of user, each can have slightly different layout.
! The 1st rule is a very tiny placeholder almost unnoticiable and the 2nd doesn't change looking.
! I don't think they're worth being added with the risk of FP.
! If ever to add, at least will make more specific like blog.goo.ne.jp###in-center > .content-2c > .content-top
blog.goo.ne.jp##.content-bottom
blog.goo.ne.jp##.content-top
www.nikkei.com##.k-hub-footer-link__item--mpu
! Doesn't change looking
asia.nikkei.com##div[class^="ad-"]
! No change on looking
game8.jp##.l-jack__top_container
sankei.com#?#div[style="width:300px;height:600px;"]:not(:has-text(/\S/))
! No change
shindanmaker.com##.taboola_block1
uwagakisimasuka.blog.fc2.com##.adsbygoogle + script + br
! Added to EL
seiga.nicovideo.jp###top_ads_box
seiga.nicovideo.jp##.ads_prtext
! ---------- Can be added to Spyware filter ----------
!
! https://www.homes.co.jp/
||homes.co.jp/_ajax/account/last_access/
/ga.js|$domain=2nn.jp
! http://shioring78.hatenablog.com/entry/2020/07/03/191802
||adtrust.appspot.com^
! https://tver.jp/feature/f0053680
||interactive-circle.jp^
||stats.streamhub.io^
! https://tver.jp/episode/73779888
||litix.io^
! e.g. https://www.wowkorea.jp/news/enter/2020/0704/10263646.html
! This covers bunch of genieespv CNAME tracker actually in use in Japan
! See https://git.frogeye.fr/geoffrey/eulaurarien/issues/18
! Not all entries in the list are actually used
/^https?:\/\/js\.[-.0-9a-z]+\/t\/[0-9]{3}\/[0-9]{3}\/a[0-9]{7}\.js$/$script
! https://w.atwiki.jp/gcmatome/pages/1231.html
! From EasyPrivacy
/js/counter.js?
_analytics.js?
! https://www.nikkei.com/
! https://www.nikkei.com/article/DGXMZO54866980W0A120C2MM8000/
||nikkei.com/.resources/tracking/
||nikkei.*^*/SC/
||nikkei.*^*/SC2/
! https://asia.nikkei.com/Spotlight/Coronavirus/Taiwan-fines-coronavirus-patient-10-000-for-hiding-illness
||astat.nikkei.com^
! https://www.businessinsider.jp/
! From EasyPrivacy
/pv_count.
! http://nicoco.net/
/entry.count?
! e.g. http://buhidoh.net/blog-entry-42729.html
/cdn-cgi/bm/cv/*
! http://h723.blog.fc2.com/
||accaii.com^$third-party
DandelionSprout
commented
4 years ago Can DandelionSprout report back to Nano-contrib about rules taken from it?
Will do at some point this week, but I'm unsure if I can do so tonight.
Yuki2718
commented
4 years ago For easier copy & paste, doesn't mean no correction/amendment will be needed:
! ad servers
||adp.homes.co.jp^
||api.primecaster.net^
||genieedmp.com^
||gmossp-sp.jp^
||okbp.xyz^
||primead.jp^
! Anti-adblock
||diamond.jp/go/pb/forbrave/
! generic hide
##.google-afc-image
! specific
||cloudfront.net/images/banner/250_50_$domain=zaif.jp
zaif.jp###banner_head
zaif.jp##.banner-kv
||file.buhidoh.net/uploads/$subdocument
buhidoh.net###center-left > .plugin3_outline
buhidoh.net###center-left > .plugin3box
buhidoh.net###right > .plugin2_outline:last-child
buhidoh.net###text-3
buhidoh.net#$##center-left { height: auto !important; }
||file.dousyoko.net/uploads/$subdocument
dousyoko.net##.floatbox1
dousyoko.net##.floatbox2
dousyoko.net##.plugin2_outline
dousyoko.net##.plugin3_outline
||jorudan.co.jp/com/img/bnr/w685_
||nikkei.jp^*/f1h_text1.js|
||partsa.nikkei.com/static/nkis/js/foneH.js
www.nikkei.com##.PRb
www.nikkei.com##.k-ad__text
www.nikkei.com##.k-hub-pr
www.nikkei.com##.newsTrendWatch
||smtgvs.weathernews.jp/s/topics/img/banner/
weathernews.jp#?#.block:has([id^=div-gpt-ad])
weathernews.jp#?#.block:has(script[src$="/yads.js"])
2nn.jp##.ads
5ch.net###banner
alc.co.jp###news > ul
alc.co.jp###container > div[style^="width:1100px; "]
allabout.co.jp##.aa_rec-box
allabout.co.jp##.js-ui-top-banner-animation
ascii.jp##.ad
asia.nikkei.com##.article__footer:last-child
atwiki.jp###ads
atwiki.jp###google_relate_ads
businessinsider.jp##.f-content-secondary > style + div
businessinsider.jp##.p-post-content > div > p:first-child
daily.co.jp##.pnl-aside
daily.co.jp##.recommend
diamond.jp###dol17_article_recm_pc
diamond.jp##.pr-icon
diamond.jp##.pr-icon + .top-article
diamond.jp##.sub-trend-watch
ejje.weblio.jp###footFixBar
eow.alc.co.jp##.ad_left
eow.alc.co.jp##.five
firestorage.jp###mains > .minispace2
h723.blog.fc2.com##div[align="left"]
h723.blog.fc2.com##div[align="left"] + div[style]
h723.blog.fc2.com##.plugin1_outline:first-of-type
h723.blog.fc2.com##.plugin1_outline:nth-of-type(n+3)
hateblo.jp,hatenablog.com,hatenablog.jp,hatenadiary.com,hatenadiary.jp,hatenadiary.org##.sleeping-ads
hatenablog.com##.serviceTop-recommend-ad
homes.co.jp##.adPremium
infoseek.co.jp###bannerblock
lifehacker.jp##.lh-banner
mainichi.jp###main > .no-print
mainichi.jp##.apply-link + .ad
mainichi.jp##.article .ad
momoniji.com###content-top-in > .widget-content-top:first-child
min.dododori.com###fix-space
mixi.jp##.COMMUNITY_bodyArea__subArea > .adBanner:first-child + .COMMUNITY_rightAreaBox
nicoco.net###search_form_wrap > div
picrew.me##.imagemaker_ad_wrapper
picrew.me##.search-Sidebar
picrew.me##.c_related_section:first-of-type
poipiku.com##.SideBarMid
seiga.nicovideo.jp##.level_ad
shindanmaker.com###sm_pc_head_728x90_bl
tenki.jp##div[class^=tenki-ad-]
tinami.com###main > .eventmesh + .text
toranoana.jp##.tora-ads-default
wowkorea.jp##div[style="width:300px;height:250px;"]
www.weblio.jp###adPcBnrWrp
www.weblio.jp##.ads-loader
www.weblio.jp##.firstDictBnr
www.weblio.jp##.rectangle-ads-frame-www
! extension
ejje.weblio.jp#?#.mainBlock:has(.flex-rectangle-ads-frame)
ejje.weblio.jp#?#.sideBlock:has([id$=AdId])
momoniji.com#?#.widget_pc_text:has(script[src^="https://ad-nex."])
sankei.com#?#.row:has(div[id^="div-gpt-ad-"])
uwagakisimasuka.blog.fc2.com#?#.side_plugin:has(.adsbygoogle)
weathernews.jp#?#.block:has([id^=div-gpt-ad])
weathernews.jp#?#.block:has(script[src$="/yads.js"])
! css
uwl.weblio.jp#$##side { display: none !important; }
uwl.weblio.jp#$##main { width: 1325px !important; padding-left: 15px !important; }
! mobile
momoniji.com#?#.widget_mobile_text:has(script)
! for Chinese filters
||53orz.com^$domain=hotpress.info
hotpress.info##.widget_text:first-child
hotpress.info##.widget_text:nth-of-type(n+5)
hotpress.info#%#//scriptlet('prevent-setTimeout', 'nextFunction', '2000')
Alex-302
commented
4 years ago Great, thanks) I will add them.
Yuki2718
commented
4 years ago Please also consider trackers in the bottom of https://github.com/AdguardTeam/AdguardFilters/issues/58587#issuecomment-654244903, didn't include in the last post as they need to be checked by you.
Alex-302
commented
4 years ago Alex-302
commented
4 years ago Please also consider trackers in the bottom of #58587
Ok, will check them a bit later.
Alex-302
commented
4 years ago @Yuki2718 Could you please provide few samples for this regex?
/^https?:\/\/js\.[-.0-9a-z]+\/t\/[0-9]{3}\/[0-9]{3}\/a[0-9]{7}\.js$/$script
(I see https://js.monetize-ssp.com/t/374/566/a1374566.js)
liamengland1
commented
4 years ago @Yuki2718 do you think this is ok to add for yahoo.co.jp? does anyone even use that site?
||yimg.jp/*/brandpanel-$script
||yimg.jp^*/luft.$script
||yimg.jp^*/rapid/$script
||yimg.jp^*/rapid-$script
||yimg.jp^*/rapidjp-$script,domain=~map.yahoo.co.jp
||yimg.jp/*/std-min.js$script
||yimg.jp/*/ual-$script
||yimg.jp/*/useraction-$script
||yimg.jp/images/map/*/banner$script,domain=map.yahoo.co.jpis this domain a tracker on ozmall.co.jp? gacraft.jp
DandelionSprout
commented
4 years ago My personal understanding is that Yahoo! Japan is actually one of the very biggest sites in the entire country, around 15 years after Yahoo! collapsed in the rest of the world.
Yuki2718
commented
4 years ago @Alex-302 e.g.
http://deliciousicecoffee.jp/
https://www.minkou.jp/
http://news-select.net/@llacb47 @DandelionSprout is right. IIRC, blocking all the rapid staff caused trouble on some Yahoo JP pages. So far my personal list only has
||s.yimg.jp/images/chie/js/ChieRapid3Common
||s.yimg.jp/images/ds/rapid/
||s.yimg.jp/images/rapid/but I haven't tested all the Yahoo services as I don't have an account. So I tend to be cautious to block Yahoo JP tracker, particularly after seeing a maintainer of Mochi filter reverted some of his tracker rules back with comments that they broke Yahoo JP mail, search, etc. I'm going to test some rules suggested with a test account, but it's impossible to test all their services as they provide so many.
||yimg.jp/images/map/*/banner$script,domain=map.yahoo.co.jp
is perfectly okay for me (actually I have ||s.yimg.jp/images/map/promo/map_pr/banner/$domain=map.yahoo.co.jp) though some banners may potentially be useful - I think they are not very informative and finding links to those promoted Yahoo services is easy.
Ozmall looks like a legitimate site. Gacraft is a "recommendation with ads" provider, similar to Cxense or Taboola, and popular in Japan next to these two, rcm.shinobi.jp, Logly, and Popin. These are difficult to decide, EasyPrivacy blocks all Cxense but when it comes to Taboola EL/EP block them partially and whole block is done in Annoyances - same goes for rcm.shinobi.jp. So far gacraft's ads are blocked by an EL rule /advertisement_ and I think this is enough.
Hopefully I can be forgiven for skipping most of the issue template, since this entry submission involves no less than 47 websites.
Essentially, it has been brought to my attention today that AdGuard Japanese can appear to be pretty small (~1,600 entries), and that an up-and-coming Japanese enthusiast believed back in March that AdGuard Japanese had an underrepresentation of mainstream Japanese websites.
So I've decided to do something about it, by going through №30 through 100 of https://domaintyper.com/top-websites/most-popular-websites-with-jp-domain, and submitting 70 entries from a total of 47 websites, to help establish AdGuard Japanese as the best JP-sites-only list once and for all. You are welcome to add whichever ones you want to add, but generally speaking, the more the better:
System configuration
Filters: