uBlockOrigin / uAssets

Resources for uBlock Origin, uMatrix: static filter lists, ready-to-use rulesets, etc.
GNU General Public License v3.0
3.61k stars 695 forks source link

A+ Content Delivered by Flixmedia is blocked #13284

Closed Rohith-Flix closed 2 years ago

Rohith-Flix commented 2 years ago

Prerequisites

I tried to reproduce the issue when...

URL(s) where the issue occurs

All product pages where Flixmedia content is delivered.

For example, https://www.harveynorman.com.au/samsung-65-inch-q60a-4k-qled-smart-tv.html

Describe the issue

Hi Team,

Retailers in AU and NZ have been trying to integrate Flixmedia (https://www.flixmedia.com/) on their product pages to receive A+ content directly from brands through a single line of JS Code. Unfortunately, they have reported that all requests from Flixmedia on their product pages are being blocked by ublock Origin.

There are many retailers across AU and NZ who have reported this issue. For example Bing Lee in AU, Mwave in AU and many other

Flixmedia as a business, helps Brands and Retailers SELL MORE! We deliver rich content automatically onto retailer product pages through a single line of JavaScript Code. All the rich content is provided to us by the brand directly - content authorized by the brands (like LG, Samsung etc.,)

Here is a live example highlighting the services we deliver, https://www.harveynorman.com.au/samsung-65-inch-q60a-4k-qled-smart-tv.html

Service 1 - HotSpots - https://prnt.sc/0Q4OjpCgaIXM Service 2 - MiniSites - https://prnt.sc/xupvGAq09tYT Service 3 - INpages - https://prnt.sc/04yKdRR70r9V

Requests that are being blocked, https://prnt.sc/QpJEretev4_4 https://prnt.sc/vqQQpjWil4fd

All the requests from Flixmedia are blocked by uBlock Origin https://prnt.sc/Gi1_BtKReEO-

Could you please test the above page and help in whitelisting our domains for seamless delivery of A+ (Rich Content) content directly onto product pages?

Here are the domains that needs to be whitelisted,

1. media.flixcar.com
2. media.flixfacts.com
3. logo.flixfacts.co.uk
4. media.flixsyndication.net
5. t.flix360.com
6. Syndication.flix360.com
7. content.jwplatform.com
8. assets-jpcust.jwpsrv.com
9. ssl.p.jwpcdn.com
10. *.cloudfront.net
12. media.pointandplace.com
13. player.pointandplace.com
14. t.pointandplace.com
15. *.flix360.com
16. *.flix360.io
17. intent://arvr.google.com
18. dev-origin.flixsyndication.net (for staging)
19. dev-delivery.flix360.com (for staging)

The Intent protocol should be whitelisted like this: https://user-images.githubusercontent.com/105775065/168983608-3eafe62f-3a90-46e2-b4fa-f17a07d016cc.png

Will look forward to have this issue resolved as early as possible.

Best Regards, Rohith P

Screenshot(s)

https://user-images.githubusercontent.com/105775065/168981120-7f4eac0e-db5c-4ee2-9a25-e35092c285ad.png

uBlock Origin version

1.42

Browser name and version

Chrome Version 101.0.4951.67

Settings

No Changes done

Notes

No response

mapx- commented 2 years ago

The resources are mainly blocked by Easyprivacy list (not a uBO list). However let's see all the improvements we can reach and we'll contact the maintainer.

Test

@@||googletagmanager.com/gtm.js?id=GTM-3W36$script
||flixcar.com/*/tracking/$important
||flixcar.com/delivery/$badfilter

For any other blocked resource provide example cases and what's broken

Rohith-Flix commented 2 years ago

uBlock details.xlsx I have tested couple of Retailer product pages, and noticed that all the requests delivered by Flixmedia are blocked. Please find the attached list of domains triggered with and without uBlock origin on the URL's highlighted.

mapx- commented 2 years ago

I tested on https://www.harveynorman.com.au/samsung-65-inch-q60a-4k-qled-smart-tv.html The filters I provided above work fine on it.

You are using googletagmanager.com to deliver your content / scripts. Are you able to provide all the id for all those retailers ? (such as id=GTM-3W36) If not => a list of those sites ?

We can not whitelist googletagmanager.com/gtm.js for all the pages in the world.

Rohith-Flix commented 2 years ago

Harvey Norman Australia is using Google Tag Manager to integrate our script, however there are other retailers like Croma in India who have integrated our script directly on their pages - and I see that the content is being blocked. URL : https://www.croma.com/bose-700-noise-cancelling-bluetooth-headphones-sliver-luxe-/p/218849 https://prnt.sc/zkwK0OZz5b2c

Our content is ideally delivered under "Product Showcase" tab on this retailer website. When uBlock Origin is enabled, the content isn't loading - could you please test?

Below are the services that we deliver on this page, https://www.croma.com/bose-700-noise-cancelling-bluetooth-headphones-sliver-luxe-/p/218849

Service 1 - HotSpots & WebAR - https://prnt.sc/fw6a_DWkOavG Service 2 - MiniSites - https://prnt.sc/Ri_jJ_X1zWGr Service 3 - INpages - https://prnt.sc/LnZe25p5vcET (all the way down)

We technically need the Domains listed in my above comment to be Whitelisted - the list of domains doesn't contain Google Tag Manager.

mapx- commented 2 years ago

on croma all fine if you use my filters above

||flixcar.com/*/tracking/$important
||flixcar.com/delivery/$badfilter

but the page has an issue I guess: even whitelisting the site, flix stuff appears ONLY if you scroll down the page and then go back to the top

mapx- commented 2 years ago

In this moment for the examples above we have 3 working filters

@@||googletagmanager.com/gtm.js$script,domain=harveynorman.com.au
||flixcar.com/*/tracking/$important
||flixcar.com/delivery/$badfilter
Rohith-Flix commented 2 years ago

Where do we need to add these filters? Could you please help us with more detail on how we can make this work?

mapx- commented 2 years ago

I thought you already tested using my filters .. You should add them in "my filters" section (right click uBO icon, options, "my filters" tab, add the filters, click "apply changes")

The goal is adding them to the official lists but now we are testing your sites, right ?

Rohith-Flix commented 2 years ago
||flixcar.com/*/tracking/$important
||flixcar.com/delivery/$badfilter

I have added above filters to Croma product page, and it is now working as expected - A+ Content is being delivered.

Integration is slightly different on Croma, wherein they trigger Flixmedia script only when a shopper scrolls down.

What are the next steps to make sure this filters apply across ALL our retail network?

mapx- commented 2 years ago

You have to test other pages to see if there are still issues.

I already notified Easyprivacy maintainer to take a look here, if for him is all ok he'll fix the issue in Easyprivacy list (and in 4-5 days all your clients / partners will receive automatically the updates).

It would be better for you to test quickly some other pages to see if all it's ok.

Rohith-Flix commented 2 years ago

I will have this checked and confirm as early as possible in the same thread. Thanks for your support.

mapx- commented 2 years ago

I'll add for now the filters in quick-fixes list just waiting easyprivacy decision (and the updates will be very fast - 1 day)

Rohith-Flix commented 2 years ago

Hi, Just wanted to check if there is any update on the above

mapx- commented 2 years ago

If your network is using uBO it's already fixed (see commit above).

mapx- commented 2 years ago

@ryanbr

Rohith-Flix commented 2 years ago

Content is still being blocked and not rendering. Are the filters added to the list?

mapx- commented 2 years ago

I'll add for now the filters in quick-fixes list just waiting easyprivacy decision (and the updates will be very fast - 1 day)

Rohith-Flix commented 2 years ago

so are we waiting on easyprivacy decision? could you please loop the relevant PIC from easyprivacy who would be able to support on this?

mapx- commented 2 years ago

I fixed the issue in quick-fixes list (as I already wrote above) uBO will update that list in maximum 1 day.

Easyprivacy (@ryanbr maintainer) could help who is using other adblockers.

Rohith-Flix commented 2 years ago

@mapx- Thanks for your support in having it fixed for uBO. I will give it a day and check again tomorrow to see if the content is rendering as expected with uBO extension enabled - will keep you posted.

@ryanbr - Could you please assist in applying a similar fix on Easyprivacy, for seamless delivery of our rich content to pages using other adblockers?

Rohith-Flix commented 2 years ago

@mapx- @ryanbr - I have tested on the below product page and the content is still being blocked when uBlock Origin extension is enabled, https://www.currys.co.uk/products/samsung-ue65tu7020kxxu-65-smart-4k-ultra-hd-hdr-led-tv-10213566.html

mapx- commented 2 years ago

currys - unfortunately - implemented your stuff differently

needing:

@@||assets.adobedtm.com/*-source.min.js$script,domain=currys.co.uk
@@||currys.co.uk/on/*/js/tracking.js$script,1p

@ryanbr

mapx- commented 2 years ago

That's why I asked you to test various / more pages .. quickly to have a fast response from easyprivacy too. Added in uBO internal list for now.

Rohith-Flix commented 2 years ago

Thanks @mapx-

There are over 1600 retailers in our network and every retailer has their own way of implementing Flix code. I am afraid and not sure if we would be able to test across ALL retailers. Let me randomly check our top retailers and confirm back.

Yuki2718 commented 2 years ago

@Alex-302 If you agree to the above, the following should be removed from AGTPF as well:

||flixcar.com^$third-party
||flixfacts.com^$third-party

and add these:

||flixcar.com/*/tracking/
@@||googletagmanager.com/gtm.js$domain=harveynorman.co.nz|harveynorman.com.au
Alex-302 commented 2 years ago

@Yuki2718 Ok. Exclusion + $redirect rule.

Rohith-Flix commented 2 years ago

@mapx- We have found an other retailer facing the same issue - https://www.mumzworld.com/ar/dyson-outsize-cordless-vacuum

Could you please check?

mapx- commented 2 years ago

This should work, test on your side:

@@||googletagmanager.com/gtm.js$script,domain=mumzworld.com

mapx- commented 2 years ago

@ryanbr

Rohith-Flix commented 2 years ago

please add for both the versions of their website,

@@||googletagmanager.com/gtm.js$script,domain=mumzworld.com @@||googletagmanager.com/gtm.js$script,domain=saudi.mumzworld.com

mapx- commented 2 years ago

domain=mumzworld.com is working for subdomains too

Rohith-Flix commented 2 years ago

domain=mumzworld.com is working for subdomains too

Thank you

ryanbr commented 2 years ago

Are you intentionally breaking these sites to allow googletag? because it looks a lot like it. @Rohith-Flix

Rohith-Flix commented 2 years ago

Are you intentionally breaking these sites to allow googletag? because it looks a lot like it. @Rohith-Flix

No, we technically just want Flix rich content to be delivered to Retailer product pages.

Rohith-Flix commented 2 years ago

On a separate note, our team internally is testing on top retailers across our network with uBlock Origin enabled in browser extension. Will share the list of product pages, where content is being blocked by uBlock Origin. Thanks

ryanbr commented 2 years ago

If you're testing with uBO, then stop relying on GTM. So it won't break.

mapx- commented 2 years ago

If you're testing with uBO, then stop relying on GTM. So it won't break.

The fact is there are a lot of sites with their own implementations

Rohith-Flix commented 2 years ago

If you're testing with uBO, then stop relying on GTM. So it won't break.

@ryanbr - There are few retailers who are implementing our script through GTM or Adobe Dynamic Tag Manager. Are you able to allow only the Flix script/domains to get through for retailers using GTM to integrate our code?

ryanbr commented 2 years ago

We've fixed the flixmedia stuff, other 3rd-party shouldn't be a requirement. So blocking gtm or adobe shouldn't also break .

Rohith-Flix commented 2 years ago

We've fixed the flixmedia stuff, other 3rd-party shouldn't be a requirement. So blocking gtm or adobe shouldn't also break .

so this means, Flix content will render automatically if the retailer implements the code through GTM or Adobe?

ryanbr commented 2 years ago

Have GTM or adobe implemented, that's fine. Just don't make it a requirement to make things work. We're not expected to fix thousands of sites because there is a hardcoded requirement for gtm.

Rohith-Flix commented 2 years ago

Have GTM or adobe implemented, that's fine. Just don't make it a requirement to make things work. We're not expected to fix thousands of sites because there is a hardcoded requirement for gtm.

I am not sure if you are getting me right. Let me re-iterate what we do as a business - Flixmedia delivers rich content directly onto RETAILER (Harvey Norman or Noel Leeming or Currys) product pages through a line of JavaScript Code. Now it's completely with the retailer on how they would like to implement our JavaScript Code. Few directly add the code to their HTML and few implement through extensions or plugins.

For example,

My only requirement here is to allow Flix content to be delivered seamlessly across all our retailer network, though they are using GTM or Adobe or any other extensions for implementing our script. Is this something possible without whitelisting GTM or Adobe or other extensions?

Rohith-Flix commented 2 years ago

@ryanbr - Just wanted to follow-up and check if there is any other way to allow Flix content on product pages without whitelisting GTM and Adobe for retailers using these tag management systems to integrate our Flix script.

Rohith-Flix commented 1 year ago

@mapx- Similar issue for https://www.lacuracao.pe/curacao/marcas-logitech/mouse-inal%C3%A1mbrico-logitech-mx-master-3---mx-master

I have added the below in my filters and it is working as expected, @@||googletagmanager.com/gtm.js$script,domain=lacuracao.pe

Is there a way we could only allow Flix JS to be triggered for retailers integrating our code through GTM or Adobe?

May be like, @@||googletagmanager.com/gtm.js$FlixScript

Not sure on how the technicality works, but just wanted to check.

mapx- commented 1 year ago

Is there a way we could only allow Flix JS to be triggered for retailers integrating our code through GTM or Adobe?

no way. I added the new exception in unbreak list.

@ryanbr

Rohith-Flix commented 1 year ago

@mapx- Could you please check for the below link as well?

https://www.tsbohemia.cz/philips-qp220-50-oneblade-nahradni-brity-2ks_d375168.html

Content is being blocked.

Rohith-Flix commented 1 year ago

@mapx- We have a new retailer who has added our script through GTM, and it is being blocked by ad-blockers. Could you please check? https://www.teds.com.au/canon-powershot-g7x-mark-ii

MasterKia commented 1 year ago

Now it's completely with the retailer on how they would like to implement our JavaScript Code.

My only requirement here is to allow Flix content to be delivered seamlessly across all our retailer network

Then it's on you to make it a requirement for the retailers to not use GTM or Adobe to implement your services.

Rohith-Flix commented 1 year ago

Thanks for your feedback. We do suggest the retailer to add the code directly to their template, however there are few retailers who prefer to add the code through GTM or Adobe or Plugins (for Wordpress). It would be great if you are able to create an individual tag for Flixmedia which will allow the content to render though Retailer is using GTM or Adobe or a Plugin.

MasterKia commented 1 year ago

however there are few retailers who prefer to add the code through GTM or Adobe

So you do acknowledge that your request to whitelist GTM for those sites, exposes users to tracking by Google; and you're okay with this?