[Google Ads Transparency Center API] Extract results that required login

[tenhoudaisangen]

Not Working Example: [Playground Link 1] [Working in ATC 1] [Playground Link 2] [Working in ATC 2]

Working Example: [Working Example 1] [Working Example 2]

Some domains when placed in the text field causes the Google Ad Transparency Center API to return fully empty even though there is a working version of the same query when going directly to https://adstransparency.google.com/

[tanys123]

Thanks @tenhoudaisangen for reporting the issue 👍

After some investigation, some ads like (truthfinder.com) required login to view them. You can try the link in incognito mode, and there will be no ads.

I can make it work as a prototype (by using cookies) but haven't yet found a viable solution for production. I will let you know if there is an update on this.

[alexbarron]

Received another request:

Intercom

[hartator]

We can't do this legally if it's behind a login page.

[alexbarron]

We can't do this legally if it's behind a login page.

Yep, I set that expectation with the user already, but logged it here anyway since there's an open issue. Sounds like it would make sense to close this as unplanned?

[hartator]

Yep, I set that expectation with the user already, but logged it here anyway since there's an open issue. Sounds like it would make sense to close this as unplanned?

Yes, we can double check their ToS, but usually it means we can't scrape data behind a login wall.