martinratinaud
commented
2 years ago So this is a 403 problem and thus very difficult to bypass
Here is what I've tried (based on https://book.hacktricks.xyz/pentesting/pentesting-web/403-and-401-bypasses)
- Adding Header 'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36',
- Adding Header Host:"google.com",
- Adding Header 'Accept-Encoding': 'br, gzip, deflate',
- Adding Header Accept: 'test/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8',
- Adding Header Cookie: '',
- use fuzzy path "https://www.amazon.co.uk**/%2e**/gp/help/customer/display.html/?ie=UTF8&nodeId=1040616&ref_=a20m_us_fnav_l_cndtns_gb"
- use another fuzzy path "https://www.amazon.co.uk/gp/help/customer/**DI**splay.html/?ie=UTF8&nodeId=1040616&ref_=a20m_us_fnav_l_cndtns_gb"
Funnily enough, this last one worked (but only once)
Here is the html resulting
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=UTF-8"/>
<title>Page Not Found</title>
<style type="text/css">
a:link { font-family: verdana,arial,helvetica,sans-serif; color: #004B91; }
a:visited { font-family: verdana,arial,helvetica,sans-serif; color: #996633; }
a:active { font-family: verdana,arial,helvetica,sans-serif; color: #FF9933; }
</style>
</head>
<body bgcolor="#FFFFFF" text="#000000" style="font-family: verdana,arial,helvetica,sans-serif;">
<!--
To discuss automated access to Amazon data please contact api-services-support@amazon.com.
For information about migrating to our APIs refer to our Marketplace APIs at https://developer.amazonservices.com/ref=rm_5_sv, or our Product Advertising API at https://affiliate-program.amazon.com/gp/advertising/api/detail/main.html/ref=rm_5_ac for advertising use cases.
-->
<center>
<a href="/ref=cs_404_logo">
<img src="https://images-eu.ssl-images-amazon.com/images/G/02/ShoppingPortal/logo._TTD_.png"
alt="Amazon" border="0"/>
</a>
<table border="0" align="center" style="margin-top: 20px;">
<tr>
<td>
<img src="https://images-eu.ssl-images-amazon.com/images/G/02/x-locale/common/kailey-kitty._TTD_.gif" width="40" height="35" border="0">
</td>
<td>
<b style="color:#E47911">Looking for something?</b>
<br/>
We’re sorry. The Web address you entered is not a functioning page on our site.
<br/><br/>
<img src="https://images-eu.ssl-images-amazon.com/images/G/02/x-locale/common/orange-arrow._TTD_.gif" width="10" height="9" border="0">
<b><a href="/ref=cs_404_link">Click here to go back to the Amazon home page</a></b>
</td>
</tr>
</table>
</center>
</body>
</html>
<!-- fdddb3ff -->We thus have two options
- implement a retry mechanism through proxy such as the one Previously setup
- contact api-services-support@amazon.com to ask for whitelisting
IMO
- proxy retry is complexifying the code but should also work and be setup soon
- contacting support should be done but may take ages
@MattiSG what do you think?
OTA-Bot
This service is not available anymore. Please fix it.
InaccessibleContentError: The document cannot be accessed or its content can not be selected: Received HTTP code 403 when trying to fetch 'https://www.amazon.co.uk/gp/help/customer/display.html/?ie=UTF8&nodeId=1040616&ref_=a20m_us_fnav_l_cndtns_gb'Here some ideas on how to fix this issue:
Or on your local: http://localhost:3000/contribute/service?step=2&url=https%3A%2F%2Fwww.amazon.co.uk%2Fgp%2Fhelp%2Fcustomer%2Fdisplay.html%2F%3Fie%3DUTF8%26nodeId%3D1040616%26ref_%3Da20m_us_fnav_l_cndtns_gb&name=Amazon%20Advertising&documentType=Terms%20of%20Service&selectedCss[]=.help-content&expertMode=true
And some info about what has already been tracked
See original JSON file: https://github.com/ambanum/OpenTermsArchive/blob/master/services/Amazon%20Advertising.json
Thanks