[Google Ads Transparency Center] Scrape Destination URLs

[schaferyan]

A user recommended we scrape destination URLs for ads in Google Ads Transparaency Center searches.

At first, I thought this wouldn't be possible, since Google doesn't seem to provide a clickable link to the destination for these ads.

However, the users provided their WIP implementation for this, which involves executing some JavaScript.

Front

[hartator]

@schaferyan Do you think they actually mean this page?

We can potentially add a new API to support this page, but I don't see any destination URL as well in there.

[schaferyan]

@hartator I think they mean the actual web page the ad would link to, in this case "https://gosolar.yessolarsolutions.com/".

It does look the partial solution they shared would include making an additional call to get the Ad Details page.

I agree that it doesn't look like the URL is available there either, but they seem to have found a method of retrieving it, at least for "image ads".

[hilmanski]

I believe this is related to https://github.com/serpapi/public-roadmap/issues/1310. While that feature request is to scrape the details page, we can add the destination-url as one of the responses. I'll add the comment on that thread as well.

Once that details API is implemented, we can get the destination URL from the adurl= parameter.

*So far, I can only see the link in image format.

Another customer requested this feature in the past: Intercom