Check Top 100 websites for ad detection

[dhowe]

Visit the homepage of each of the top 100 websites with 3 separate browser profiles: AdNauseam+AdBlock Plus, AdBlock Plus Only, and No Extensions. Note the following:

1. the number of (visible) ads on each site,
2. any pages where AdNauseam does not find any ads at all
3. in such cases, categorize the missed ads (flash-ad, text-ad-w-no-regex, script-blocked, etc)

This will probably take some time, so I've marked the priority as low, however please return to this between tasks, or if you need a break from whatever you are working on...

[dhowe]

Do the first 10, then change the priority back to LOW... then continue when you have time

[CyrusSUEN]

Firefox 37 ADN v1.18 Ad filters: EasyList + China List (for there are many Chinese websites among the list) Adblock Warming Removal List

List of top 10 sorted by ranking

• Google (https://www.google.com/) Number of visible Ad(s): 0 OK
• Facebook (https://www.facebook.com/) Number of visible Ad(s): 0 OK
• YouTube (https://www.youtube.com/) Number of visible Ad(s): 1 Missing Ads: 1 Flash-ad banner ad IGNORE
• Baidu (http://www.baidu.com/) Number of visible Ad(s): 0 OK
• Yahoo! (https://us.yahoo.com/) Number of visible Ad(s): 2 one Ad Choice and a group of 4 Yahoo Ads Missing Ads: all JavaScript error NEEDS REGEX: .ad-tl1

  fpad2

  ad-west

  .rmx-ad .fpad .lrec

• Wikipedia (http://en.wikipedia.org/) Number of visible Ad(s): 0 OK
• Amazon (http://www.amazon.com/) Number of visible Ad(s): 1 Missing Ads: all script blocked NEEDS REGEX: .displayAd

  nav-swmslot

• Twitter (https://twitter.com/) Number of visible Ad(s): 0 OK
• Taobao (http://hk.taobao.com/) Number of visible Ad(s): 0 OK
• Tencent QQ (http://www.qq.com/) Number of visible Ad(s): 12 Missing Ads: all JavaScript error NEEDS REGEX: 2 Ads from tmall.com have no regex .adLeft .adRight

[dhowe]

Good work... next steps:

• Record the # of fixable ads for each site (those that are not flash and not internal). Add them to the iframe count if these ads appear in iframes, and if so, add notes to the iframe structure column. Add yellow highlight in spreadsheet for all sites with fixable ad count > 0.

• Try fixing each of these sites by adding the site to the 'whitelistedScriptDomains' array in lib/parser.js, then restarting (with cfx), and reloading the site. In the console you should see a message like:

  console.log: adnauseam: *\ Allowing ABP-blocked script: http://ads.cloudfront.net/sf1.16.js)

• Try one at a time and simply note (in the spreadsheet) whether a) you see an 'Allowing' message in the console, and b) whether the change causes any new ads to show up (don't need to commit any code changes yet)
• When the above is done, we can then work on elemhide rules for recognizing these.

[dhowe]

@CyrusSUEN please add these as well:

• http://www.ebizmba.com/articles/sports-websites
• http://www.ebizmba.com/articles/media-websites
• http://www.ebizmba.com/articles/ebusiness-websites

[CyrusSUEN]

Most of them are of Google Ad Choice or Google DoubleClick, especially the top 15 sports, media and sports sites. Do you think we should create a new ticket for detecting Google Ads?

[dhowe]

yes, sounds good... include the iframe structure in the ticket

On May 7, 2015 11:51:48 PM GMT+08:00, Cyrus S notifications@github.com wrote:

Most of them are of Google Ad Choice or Google DoubleClick, especially the top 15 sports, media and sports sites. Do you think we should create a new ticket for detecting Google Ads?

---

Reply to this email directly or view it on GitHub: https://github.com/dhowe/AdNauseam/issues/266#issuecomment-99919640

[mobile]