AdguardTeam / AdGuardSDNSFilter

AdGuard DNS filter
https://adguard-dns.io/
GNU General Public License v3.0
697 stars 125 forks source link

Proposing converted entries from Liste FR #1627

Open DandelionSprout opened 3 months ago

DandelionSprout commented 3 months ago

Prerequisites

Problem description

It has been established for some time that the 23 entries from https://raw.githubusercontent.com/AdguardTeam/AdguardFilters/master/FrenchFilter/sections/adservers.txt and https://raw.githubusercontent.com/AdguardTeam/AdguardFilters/master/FrenchFilter/sections/adservers_firstparty.txt is a tad little, even if the reasoning is decent enough.

Nevertheless, I gave it a try to see "Okay, how many entries from Liste FR would be mostly okay to propose adding to DNS Filter somehow?"

The process wasn't super-easy, and would be a nightmare to automate, but I landed on the 8,462 entries in the attachment below.

Proposed solution

I went through the entirety of https://filters.adtidy.org/extension/ublock/filters/16.txt, and narrowed down the entries until the remaining ones were generally those that would make sense in DNS filtering:

Liste.FR.AdGuard.DNS.Filter.testing.txt (I apparently didn't even need to compress the file this time around.)

Additional information

I can see that https://github.com/AdguardTeam/AdGuardSDNSFilter/issues/970 discussed it to a basic extent, so I decided to play it really, really safe with the pasted file, to the point I even discarded $third-party entries; as well as almost all entries that ended with a period (.), and IP entries.

Liste FR conversions were one of the things that really made https://raw.githubusercontent.com/DandelionSprout/adfilt/master/AdGuard%20Home%20Compilation%20List/AdGuardHomeCompilationList.txt stand out from AdGuard DNS Filter, but as I gradually began losing energy to maintain the former, an inclusion of Liste FR of some sort in AdGuard DNS Filter would help me gradually narrow down the amount of entries and needed maintenance in my list, as I began conceding defeat to DNS Filter.

Nevertheless, my list still converts a few other lists that DNS Filter doesn't (Primarily EasyList Spanish, Liste AR, uBlock Filters, and Adblock Warning Removal List).

Alex-302 commented 3 months ago

The problem is that this filter includes rules that can break sites, incl. non-advertising. 90 rules are badfiltered.

Alex-302 commented 3 months ago

Also it seems 5700 domains in your list are dead:) Liste.FR.AdGuard.DNS.Filter.testing-dead.txt

DandelionSprout commented 3 months ago

Certainly explains a bit. 😅 It probably should've struck me to run PyFunceble on the results, but when more than half of them are dead, maybe someone should tell Liste FR to run PyFunceble on their list upstream first.

DandelionSprout commented 3 months ago

Based on this tip, I created https://github.com/easylist/listefr/pull/177 over at his repo, and I presume I'm awaiting his decision on the PR before I'd attempt a new conversion of some sort.

DandelionSprout commented 2 months ago

He apparently did not get the memo at https://github.com/easylist/listefr/pull/177. At all.

I'll see when, and if so how, I'll do a 2nd attempt at this issue report.

DandelionSprout commented 2 months ago

To play it ultra-hyper-safe, by almost only including domains with the word ads in them, or which began with ad. At that point it's a matter of covering French users to a basic extent, and not to take some workloads off my shoulders.

The approximately 210 proposed entries: ``` ||1-1ads.com^ ||301ads.com^ ||ad-3.me^ ||ad-center.com^ ||ad-lead.com^ ||ad-miner.com^ ||ad-sys.com^ ||ad.ccmbg.com^ ||ad.genybet.fr^ ||ad.graciamediaweb.com^ ||ad.groupon.fr^ ||ad.jeune-independant.net^ ||ad.mailo.com^ ||ad.mediabong.com^ ||ad.net-c.com^ ||ad.oujdacity.net^ ||ad.publicidees.com^ ||ad.vacanceo.com^ ||ad.zanox.com^ ||ad380.com^ ||ad6.fr^ ||ada33bea5b.com^ ||adaccess.fr^ ||adback.co^ ||adbison.com^ ||adblock.vidomo.xyz^ ||adbucks.com^ ||adc-lc.eu^ ||adcapt.com^ ||adcloud.us^ ||adconda.com^ ||adconnect.fr^ ||adcpm.com^ ||adfever.com^ ||adfornet.com^ ||adgoal.net^ ||adhispanic.com^ ||adhoc1.net^ ||adhoc2.net^ ||adhslx.com^ ||adincube.com^ ||adinfo.support^ ||adinlive.com^ ||adintop.com^ ||adlead.com^ ||adleadevent.com^ ||adleave.com^ ||adlike.net^ ||adlookr.com^ ||adlure.net^ ||adm-vids.com^ ||admailtiser.com^ ||admanmedia.fr^ ||admark.fr^ ||admarketplace.com^ ||admathhd.com^ ||admediaking.com^ ||admetix.com^ ||adminer.com^ ||admireddepend.com^ ||admiredfreakishgraveyard.com^ ||admissionmining.com^ ||admized.com^ ||admtpmp123.com^ ||admtpmp124.com^ ||admuncher.com^ ||adn-performance.com^ ||adn.tukif.com^ ||adnetpro.com^ ||adnetwrk.com^ ||adnotbad.com^ ||adnplay.com^ ||adnsolution.net^ ||adnxtr.com^ ||adoffers.network^ ||adpile.net^ ||adpixo.com^ ||adpointbreakrtb.com^ ||adpub.eu^ ||ads-blue.com^ ||ads-tracking.beop.io^ ||ads-tracking.beopinion.com^ ||ads-x.com^ ||ads.ch^ ||ads.vnhell.com^ ||ads2rtb.com^ ||adsadminister.com^ ||adsb4track.com^ ||adsbtrack.com^ ||adscafe.net^ ||adschemist.com^ ||adsclick.com.br^ ||adscoo.com^ ||adsearch.pl^ ||adserver.pm^ ||adserveradulte.com^ ||adservingsolutionsinc.com^ ||adsgarden.com^ ||adslead.com^ ||adsmansion.com^ ||adsmena.com^ ||adsoid.com^ ||adsplain.com^ ||adsplex.com^ ||adspot.ch^ ||adsregieonline.com^ ||adsrevenue.com^ ||adsrvs.com^ ||adstechnology.co^ ||adsteroid.pro^ ||adsterratools.com^ ||adstract.com^ ||adstronic.net^ ||adstune.com^ ||adsupply.dsp.wtf^ ||adsupplyads.com^ ||adsupplyads.net^ ||adsurge.com^ ||adsvidsdouble.com^ ||adsvidss.com^ ||adswinner.com^ ||adsximg.com^ ||adsxxxtraff.com^ ||adtictac.com^ ||adtracker2.com^ ||adtrafic.com^ ||adtrk20.com^ ||adturtle.biz^ ||adual.net^ ||adunblock.com^ ||advantagedoctrinepleased.com^ ||adverline.com^ ||adverteasy.fr^ ||adverti.fr^ ||advertine.com^ ||advertising-support.com^ ||advertsight.com^ ||advertsponsor.com^ ||advinapps.com^ ||advrich.com^ ||adwidecenter.com^ ||adwise.bg^ ||adxchanger.com^ ||adxcore.com^ ||adxfactory.com^ ||adxprts.com^ ||adyieldoptimizer.com^ ||adyou.me^ ||adzbux.com^ ||adzbuzz.com^ ||adzerg.com^ ||adzmath.com^ ||adzzone.com^ ||arabyads.com^ ||best-deals-products.com^ ||bitadspool.com^ ||cam4ads.com^ ||clckads.com^ ||clintads.com^ ||copyop-ads.com^ ||dialogads.com^ ||digiads.tv^ ||edgexads.com^ ||effective-ads.com^ ||eonads.com^ ||ex-ads.com^ ||explorads.com^ ||fbofferads.com^ ||gateads.co^ ||heliumads.com^ ||igadserver.net^ ||iwadserver.com^ ||juicyads.rocks^ ||kadserver.com^ ||kyoads.com^ ||lemonads.com^ ||madison-ads.net^ ||mellowads.com^ ||mhadst.com^ ||mochiads.com^ ||monarchads.com^ ||mypushads.com^ ||nativeads.rocks^ ||offpageads.com^ ||onhitads.net^ ||oxiads.fr^ ||peoplesearchads.com^ ||placedesleads.com^ ||polads.pro^ ||reactads.com^ ||redirect-ads.com^ ||rlnads.net^ ||sarmady-ads.com^ ||sharemyads.com^ ||smartxads.com^ ||stickyads.tv^ ||tamdamads.com^ ||teads.de^ ||teads.fr^ ||teads.net^ ||tradefxads.com^ ||trads.io^ ||unlockads.com^ ||voltads.com^ ||wads.ozap.com^ ||wads.plurielles.fr^ ||wbsadsdel.com^ ||wbsadsdel2.com^ ||y-ads.net^ ||zxcvads.com^ ```
Alex-302 commented 2 months ago

Dead:

Details ``` ! ||ada33bea5b.com^ ! ||adaccess.fr^ ! ||adback.co^ ! ||adconda.com^ ! ||adhispanic.com^ ! ||admetix.com^ ! ||adoffers.network^ ! ||adpile.net^ ! ||ads2rtb.com^ ! ||adstechnology.co^ ! ||adsvidsdouble.com^ ! ||adtrk20.com^ ! ||adual.net^ ! ||adyou.me^ ! ||bitadspool.com^ ! ||clintads.com^ ! ||igadserver.net^ ! ||madison-ads.net^ ! ||mypushads.com^ ! ||offpageads.com^ ! ||teads.fr^ ! ||tradefxads.com^ ! ||y-ads.net^ ! ||1-1ads.com^ ```

The rest - checked few random domains - they are not used (adsplex.com), not respond or owned probably by spammers (like admtpmp123.com, admtpmp124.com)

Details ``` ||301ads.com^ ||ad-3.me^ ||ad-center.com^ ||ad-lead.com^ ||ad-miner.com^ ||ad-sys.com^ ||ad.ccmbg.com^ ||ad.genybet.fr^ ||ad.graciamediaweb.com^ ||ad.groupon.fr^ ||ad.jeune-independant.net^ ||ad.mailo.com^ ||ad.mediabong.com^ ||ad.net-c.com^ ||ad.oujdacity.net^ ||ad.publicidees.com^ ||ad.vacanceo.com^ ||ad.zanox.com^ ||ad380.com^ ||ad6.fr^ ||adbison.com^ ||adblock.vidomo.xyz^ ||adbucks.com^ ||adc-lc.eu^ ||adcapt.com^ ||adcloud.us^ ||adconnect.fr^ ||adcpm.com^ ||adfever.com^ ||adfornet.com^ ||adgoal.net^ ||adhoc1.net^ ||adhoc2.net^ ||adhslx.com^ ||adincube.com^ ||adinfo.support^ ||adinlive.com^ ||adintop.com^ ||adlead.com^ ||adleadevent.com^ ||adleave.com^ ||adlike.net^ ||adlookr.com^ ||adlure.net^ ||adm-vids.com^ ||admailtiser.com^ ||admanmedia.fr^ ||admark.fr^ ||admarketplace.com^ ||admathhd.com^ ||admediaking.com^ ||adminer.com^ ||admireddepend.com^ ||admiredfreakishgraveyard.com^ ||admissionmining.com^ ||admized.com^ ||admtpmp123.com^ ||admtpmp124.com^ ||admuncher.com^ ||adn-performance.com^ ||adn.tukif.com^ ||adnetpro.com^ ||adnetwrk.com^ ||adnotbad.com^ ||adnplay.com^ ||adnsolution.net^ ||adnxtr.com^ ||adpixo.com^ ||adpointbreakrtb.com^ ||adpub.eu^ ||ads-blue.com^ ||ads-tracking.beop.io^ ||ads-tracking.beopinion.com^ ||ads-x.com^ ||ads.ch^ ||ads.vnhell.com^ ||adsadminister.com^ ||adsb4track.com^ ||adsbtrack.com^ ||adscafe.net^ ||adschemist.com^ ||adsclick.com.br^ ||adscoo.com^ ||adsearch.pl^ ||adserver.pm^ ||adserveradulte.com^ ||adservingsolutionsinc.com^ ||adsgarden.com^ ||adslead.com^ ||adsmansion.com^ ||adsmena.com^ ||adsoid.com^ ||adsplain.com^ ||adsplex.com^ ||adspot.ch^ ||adsregieonline.com^ ||adsrevenue.com^ ||adsrvs.com^ ||adsteroid.pro^ ||adsterratools.com^ ||adstract.com^ ||adstronic.net^ ||adstune.com^ ||adsupply.dsp.wtf^ ||adsupplyads.com^ ||adsupplyads.net^ ||adsurge.com^ ||adsvidss.com^ ||adswinner.com^ ||adsximg.com^ ||adsxxxtraff.com^ ||adtictac.com^ ||adtracker2.com^ ||adtrafic.com^ ||adturtle.biz^ ||adunblock.com^ ||advantagedoctrinepleased.com^ ||adverline.com^ ||adverteasy.fr^ ||adverti.fr^ ||advertine.com^ ||advertising-support.com^ ||advertsight.com^ ||advertsponsor.com^ ||advinapps.com^ ||advrich.com^ ||adwidecenter.com^ ||adwise.bg^ ||adxchanger.com^ ||adxcore.com^ ||adxfactory.com^ ||adxprts.com^ ||adyieldoptimizer.com^ ||adzbux.com^ ||adzbuzz.com^ ||adzerg.com^ ||adzmath.com^ ||adzzone.com^ ||arabyads.com^ ||best-deals-products.com^ ||cam4ads.com^ ||clckads.com^ ||copyop-ads.com^ ||dialogads.com^ ||digiads.tv^ ||edgexads.com^ ||effective-ads.com^ ||eonads.com^ ||ex-ads.com^ ||explorads.com^ ||fbofferads.com^ ||gateads.co^ ||heliumads.com^ ||iwadserver.com^ ||juicyads.rocks^ ||kadserver.com^ ||kyoads.com^ ||lemonads.com^ ||mellowads.com^ ||mhadst.com^ ||mochiads.com^ ||monarchads.com^ ||nativeads.rocks^ ||onhitads.net^ ||oxiads.fr^ ||peoplesearchads.com^ ||placedesleads.com^ ||polads.pro^ ||reactads.com^ ||redirect-ads.com^ ||rlnads.net^ ||sarmady-ads.com^ ||sharemyads.com^ ||smartxads.com^ ||stickyads.tv^ ||tamdamads.com^ ||teads.de^ ||teads.net^ ||trads.io^ ||unlockads.com^ ||voltads.com^ ||wads.ozap.com^ ||wads.plurielles.fr^ ||wbsadsdel.com^ ||wbsadsdel2.com^ ||zxcvads.com^ ```