search

serpapi / public-roadmap

Public Roadmap for SerpApi, LLC (https://serpapi.com)
55 stars 5 forks source link

[Google Trends API] Data for searches from 2022 is missing #561

Closed marm123 closed 8 months ago

marm123 commented 1 year ago

It appears that some searches are missing the whole 2022 data. I noticed that Google indicates, on their Trends search, that they change the data collection. I'm not sure if this is relevant, as some searches do return data from 2022, while others do not.

Search with missing 2022 data

image

Information from Google Trends search

image

Playground | Inspect

marm123 commented 1 year ago

Might be related to https://github.com/serpapi/public-roadmap/issues/300

marm123 commented 1 year ago

It appears that Google changed requests for its Trends page, making some Python libraries, like pytrends, unreliable. I'm unsure if this is relevant or related to this issue, but it's worth mentioning. Link to the Intercom thread and reported issue on pytrends GitHub repository are below:

Intercom pytrends GitHub issue

aliayar commented 1 year ago

This post from pytrends issue suggests that we may have been affected as well:

I opened an issue already for this a few weeks ago. After doing some digging, it seems Google has changed their API and is now creating "holes" in the data for scraped info.

It is also happening on large keyword tools such as Keywords Everywhere

There is now a new user in the headers, one called 'USER_TYPE_LEGIT_USER' and the other 'USER_TYPE_SCRAPER' The scraper user has the "holes" while the legit user doesn't.

nicktba commented 1 year ago

Im the poster in the PyTrends issue ^

Please let me know if you're able to find a resolution to this.

aciddjus commented 1 year ago

We are marked with USER_TYPE_SCRAPER:

image
nicktba commented 1 year ago

HTTP Error 401 Unauthorized indicates that the request lacks valid authentication credentials for the target resource.

You have to get the 'USER_TYPE_LEGIT_USER' token. Its not just replacing the userConfig

Im not sure how to do that without borrowing it from the browser

aliayar commented 1 year ago

I am curious if Google employs this technique with their other services.

ilyazub commented 1 year ago

Related question on StackOverflow: https://stackoverflow.com/q/73988220/1291371

Related issues in g-trends repository: https://github.com/x-fran/g-trends/issues/54

ilyazub commented 1 year ago

Google Trends in the browser submits a request with reCAPTCHA token. This can be a reason we get USER_TYPE_SCRAPER instead of USER_TYPE_LEGIT_USER.

image

curl 'https://trends.google.com/trends/api/explore?hl=en-US&tz=-120&req=%7B%22comparisonItem%22:%5B%7B%22keyword%22:%22filter%22,%22geo%22:%22%22,%22time%22:%22now+4-H%22%7D%5D,%22category%22:0,%22property%22:%22%22%7D&tz=-120' \
  -H 'authority: trends.google.com' \
  -H 'accept: application/json, text/plain, */*' \
  -H 'accept-language: en-US,en;q=0.6' \
  -H 'content-type: application/json;charset=UTF-8' \
  -H 'cookie: NID=511=XFlLBiX63uT_Z3MtZZcDi_qaxDIpYgCnUfralfFn4HMFnavFOeuwOejdfB_eQb8-awg_jwYANnr7dGFtK4830aAEsP6Z-cl0YxRY6L1-_Z6V2nw90m4i1VN-FpCQEWtusomgE0WfPOilk7k95hSxJbwnsdMCxVqguJLBIiIMuok' \
  -H 'origin: https://trends.google.com' \
  -H 'referer: https://trends.google.com/trends/explore?date=now%204-H&q=filter' \
  -H 'sec-fetch-dest: empty' \
  -H 'sec-fetch-mode: cors' \
  -H 'sec-fetch-site: same-origin' \
  -H 'sec-gpc: 1' \
  -H 'user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36' \
  --data-raw 'FEWyJzZXRva2VuIiwiMDNBRDFJYkxDcnUtM0JUMVpvbHR4amhCcTRHOEVEUGptRkd2Uk8xLU8wMEpIWk45S053NjVxWUJnS2JVMnhDUU8wc1lWY3EwUXpIRGNqRTVYZ2JySVgwRWQ0Uy1adC15dEF1LXFHVm9lU1k3ZjJEcXN5UDRDcTJvNmhxc1JudTdxMlJSbjIxWDN0dHVlRDBoUXVGbHNReXZGT1JnU3poUktGNHRkV1RzMEx0cElxVUFaaGxEUXpPN1NYUmc2bkM5WlJhM29Qa2l6UXFOdEMxSWFrVDBRclZwVTIzYW51emVaZFpQVFFQdjZ3bFNLaHZDOHBUZE9qcV92T0J0YXdfVjNOT3QxNGN4TTVwMHdKSmhqSERjMXBzY1hWUm56a3J5U2FaNkluVUxucUgzMEJOYkpVTTJIV0R2ODNaZkdOM3RZSUdxd2kwRzRzcnRELW5oOUFFVTNMUmR6Tlg0OWZmb0l2elc4UEF5a1MzbFF0LWJ5NjZaSzN3NzV4ZXZWS0ZSTEkyREtZTk5Md19XUEtYdG9Tc200N0JqU1RUYTBJQ0IzYXdUZlR5WTAzN3dSMWhaZmFjdGN4cEdkd2U1cUVGclFyYzhEeEF0TG8wLVdHUE9rOHJ5RHZIVzhiZGtqaTZma1RJaWlRRXJjUlRjQ0RfUnFHLXh2b0Z3czR0RE1vQlgtN3BKdVBKY2tmdUxIZWZzT3hzS2lIenhyMEJ3N014RDNadmFFUmhEa190clM5cWJibUQ5dGF3ak9OT1dkVk9sdE9waGN3S1dhbml0cTA5aE5ZdXpLRU1tMk5rajA1cFl3ZDJGODFyQldlVDRCdzdyQy1OUm4wUGxuOVJQVEVENElXbzZiUFJEaWJxNkdreVhCa3RBMmNYbzh4el96Tmp0RVZqeXZwSnI5ZkxoTDg2YlQ4VF9PalJhUW53dnp2MjdWVFM5UzZxTjdXRUdONnliU2JRSTZWYlpyN0g0Q0tjYTBJOUFqUDJManNXc29OaC1NUEFTTnJHSUFHQldDeFNJeUxzZzhITVJSVENYd2tqbmJiQXEwOUpuaFRBZklPYzhhb1R1d2x6UW9wRUdXR1NERGJzU2JEb0ZEeC1WU3lfN29Fd1RkVWpPUXVwWWJ3cWNrZXd5ZHFneVNJVk5JWUNiTlVneUxzZ0Z6eFVhWDV6VWM1NWRZaS1LbmhpeWljalI4Xzg5R2VMd3Njdi1uVGg2UXN4QXlNZkdZTEhOWnRaTmtKR3A5enUyWF9zUzFTV3haTTI0UTZfQWxPQzlHODM0UjhZWVgxc1hCWlBlSzBJdVBkY2tveXlEUWpHcDRNeVFrSFZUVjd5dWNsOWhtMnFETHp1UDBscXdCdUlURHVIRG1SOGEzLUJUa2tyN28wVlU3SGZHcVBvU2lvcnZXUmxtM0dVUE41WkpLNF9tMC1HczdDYUp0VVJPV3BUbE1UZkszbzRqS2VfRFZLb2Z0VWloZTd0djhjSWlaekxuVDM2Y195cmJqRGRYUVkteVhVVDM5TTZ2MV85NG50cXJKMk0yN1NnNktVdVJveGdKLXQiLCJBc3E1RWxoVW1qNGtfeHJ6aHBpc2VseTNGamtaenVXT2RHSWg4LXRhNWE2WHZpWjRTdUpnc3dWY1pZZmVQUGc5bFZpSHF2ekszX2Z3V1RoYXRUSE9BanlFM0VHb2ExYkpjTVFDdWsyc3J6bGE0dlNZZzZlMUZmaU1WTU91Qm9ZVC1PRjBLb2lHZ1phdkk1aURETkQ5NHE3MVROZnZubHVTeTBTMFV3MVpHYThGRHQxSDJSVUpCOWFDTkhsTzF1a2FDMjR4M2x0bzdsRjFLQ2tiQmxCQktOU1BQV1hNR2k1UlJfanJOZmFDeWxoVFJ6dHFFUjdnTDc4YkVKWW5tNEdqdE9QZWZ0WEJqQ0dVcTFDT1Q5T29mbGJaaklZT0lCMS15c05rSnhuRXI4SnMtSWFxd3piS2dOUXlPSGJRcnhISkt4TFdfQ0t2ZWhTQU02VE1wNXd1WVVUcUtWUzZieWIzcmd2X0k2WVBiZm1MalMwZjJUQm9QUEctWVV3ZHk3Uks4cFZ1MzhaUS1KT2JnT2hEYnA1eDVTR1FkTExPM0hDekZEMllfZ2N2emNkVS1Id0pFQTVBX0pkd2ZaWDNXZnB1dXZmd0hBWXVsS0t2dDEyNThWaGdtLTE1XzFnbVM2X3N0MExISGtlWmdNWjI1eDFNZlhod2R6eUlfR2p1b3RueUdvMEdMWTliMFlabzU5QkJETV9nVnVwQjhSaXptV2dWZDVHeHoxdmdNRlJRbDd6STB1NkJWSExHVm5DWmo4aEpSM09lcTg0dm9FY3ZCQlpwVGxCNG1iN09hZnk4dTRfWl9OZzV1SUR4RkRIR1JhaXpWTmR3WlFLc3c2czhRMml2dXRTUE9hV2huU08yRWRvX3BwRHdwMnFNaTlDRTIzOThCZFdDRU93NUFKeFNVeUxVdFB1Z1dBbTR3MUtmNWVEdHVzYWlQaV9VMndpSjVWdWFjYndtcnAyM29wbk12WEd1eWh5V19fRklwM19NMktPNU9pN2Q4TUxjdUhjRkE1RThEV2xvQjVjcWlIdUVERUY4ZlNtaXkwVEhiVkF0MTZtVWtNeUxlRTZ2dzdPZkppOWhURmkxcnR6MnpqSmJnWGtRWVVrbTBQTHVXNEkwQTItdnYzSXFKUm1qeDRpbmY3ekJrM3Q3WlA4cDRUeF8tWGQyeUJ4WU5HTHF6blJSck1VUjgybEdRZW5seTFCU2o1Y00yc0hhZHdCeFZHU1ZaU2Zfb1B4MjlSbXRUblNfa2hZZFhCU09ISGFCaGFkSlluUWRpMkxOenV1VWNtMlhWNzdfSjBrc0tUYzJpMHdRbFZZVjh5X05mMlY2Z2RkdFJyOElmYnJINmdGWnNmNlJHVko3OGpYSTlPZW5uRVdfRFhJN2NtS21nTUlqTFRqREx1aHF6Skp5N0lxekdwSDlRWld0ZUppT1hPS2pHX2RLTFdOU3V6V1Y1WXp4MXppM1NodUtZOThKQVIxSnh0bmlmNUVmRkx1S2FaYWZvbzFKaDBTZlZqdkNKZmNRcmhlYUtuLXhFTWs4QnZZRG9Qdl9TbC1pUm1zZjctMXNSUDV2eVpsR19CLXRCZFd1QjNqYlkxc0EtY05mTTZScm9NZU84YjVkVEY3aDluRF9rVHA2bWRoTGxjei1uR2RqT0UtclFOUElFVW5lQ3p4bmhlSzZxcWNDcXUwalpoQjNSN0Jad3JnT2pqTGlBVHZSTXVtNGp6bThhMThxdzJWVi1Jd3ZBMk9KT0FnZzhwVXp4YkFwckRJZnBWUmxNSGRtVGRxYVdyZWNZQW9YU3dyQ3VRSzh6bFVuc0VFamdIZ2plVE53aUNWV1lGeWJwNnFWblJzWmRPcllUcmQ3SzdTYnVlY1FqaUI3ZVRtTUp2NjJ0ZTh3M3BuVHY0YkY1NGZzdkk2ZlM1S0d6YXgwTmNCMWFELTQzcG9LMmQ2Y2FXS1l3bTJMaERLNGRDS3VCSURPd0NXNThyaWxHdU9zbTVXVHJMMC1sZzlzY0ZaMWQtZTFTSnllcUdyY1JvWEZjNG1yaklMRWNMQ09fMU1ZZ3JncWpYSDVubUh1clI5Ri01OWVZbTk4bUo5elg0ZmlXczExbWh5YTB3Tld2WktvaF9XcWhRSDJOVDNBX3R0YVNTNnZPR2ViajdVb2d1dmp2QXhmd1d3STlnd0I4Um04OTQ2LTA0S3FxdGJ0dEg1TEFORWdwUXl1VkpBSlR0NEIxamppMWZSTEZXNEx5dzJISFJ4aUJGM2ZZeTRWd3BZd3BSYUNvNjJpRGhpNm1wR0pKV1VZN0J1c1BSeWJWeE1oS0h5SkloQ0NIa0NzWmpWYm8yemc1WEUtR2diS0dFczFadTdzOXZLNy1NZ0tGelR2NkhjZkN1WUxQcWdCMXF0NFhoNDVNUWFJc1hhQUROTHJtWGVjelh5M00wN2NfTEs1TTVzakQ2Q042TjY1TmNBbFZTN1hCNXVqb1hrellPclJicVZuamZfSlZQeS1heWlrZnpvR3RCSFgtXzNlWUdyRS1yS3llT0xSRXV4Sk96eXZ4X2luZlhtdzZlaXhOWFNiSFo2eGQ5OXo3SFVMbGRNallBUF9Pb05mdW5JNUNLa1J2Y2NmOWgyRjZKbEF4QzBSQTF4VTZ1Y1NIRzFERkVHUlBYWXFKeEF5VmhaTHlSaHFJXzdMbHZhWVI1amJYQ3ppaENnN2FPd0xKRXFEeHI3YldiODBjUm9EQWZ3Q3lndzVNY1JDSUh3MXkwOURVQ3RFMGlqUHVnekVSR2Z0X201WHU0X3ZEdVVraFlrLXNPeURIVGRtN0xFODJhVy1iVmh1cGJMRG5jejZEWDROREZpYTVaYlQ5U29KS0JWRTJKTGdlWjdPMHoyY1BnODE1OV82eFNNSmpOemQwMXk5VEJRVUFTZV9NN1VSYnotWTZvTThHNlI0WnNPWDUydmFnY1o5Q3FMZG5jb1YyUzFMWGZibDllUTRCY19nR3A4dkNUbVNNQ3hZVWo4V1ktWTZrRm4wXzhMdkp5eW0yeFZFNVJHbVBSVk1RcEROZVp5YVdkS0RTZjJxOGwtN0VlLTg2ckJ4WUZFcjlucDVHZHFMci1vT1B1SUljY0xvb1d6V2NRWVVwZGRxV0RXVGgxOUhfR1RxV0RXakpXc2kyWV9wUVctVjBfS2pCUy1NbmlRUU9tQ3NaQzJ1c0FxUmhMeXV1bWxuT3pPcEtHSlZGazl2eGNhc0dubGIzZk4yRVhaSDJKOHRwS25ZNUpNaWd4ZUFFMjZxUUpHeEh0a05SR253R0RHOHBvemIxVTl1Sk52dzBHRnR6VnN3b2h1ZXZmdTNqWDNiNU83amg4STBMV1Q1R05TNl9CaFRYVFRJRGZKa0l1bk4yU1ZpUThsVFRqY0FlTXNnYVRrc0RnbmhCUlhmZmRTSVVCY1U3TE9EMTRMU3dkNnpxVHpRQzFRU1lfeXd4WWRIc3dOeDNqeUJ1cFU5Mk01ZFlBXzZLV1BJNnNYdkVyd0JGNjhmaEt6eTE2V1ZtX09IOWdCTVVtTWR6a2NGaHVGUkI0ZVozbkFXUDRrb1hwc2xpVEFRams4R3hfOTVzak14RmltQzMxdUh4SFZpTUtuX2xLMS1ldkN2Z2kzU2QxTlFYUk56S0tCdGZwNmZvUXBHVkoxX1NfRklMR2YycHRVZ1E5WFNVLUtNUkg5a20xOWhwNThhdnJqYzlRdEVIQ1QxZjd5VVkzQS1LNU16Y1BCbVEwb3ZPM0h4Qk1BbTg2SmZ0Z0c2ZmJlTW14TVRUVU9OX1lDcm96U0FsRk5feVhvTVMwMXEyQUZQVWV0b0Q2enJod0djNzFaNFdHcE1YR29Xd05UZGJQNHVBZXhROGhZZ0oxTmk3ZzJlaDlVbllKaDBiWUdqVlE1UWNYQ3o2SWZmVFE1d1ltcG11aENtVkNQQU8xWjJpZTVIMk5FQmVoVjZwWmQ2b3FIMXdEeURTSVJDNG41b2FWTlVfWjU1SzF2cm5VcFZFeHlIZEpKMlo4TWl3a21ZQjZpbVNrOEttY1dDVzUyR1hiVGtHSXdjRFhHUmxHbVRodWdkemdDTXQ4MW9JbVF3SkFIYmJ3ZkE1a3pBTklXUVNKNzZBd0x4UXQyVkpEeEpZeTFPN0tfaVZOd3d4UVpqNmh2eUEwb3cySkwzOEdneHF2RzlWeTdTRHVJSjNmbF9xYi1LLXI5RlJOREVOMjNSZG9JZjJMcjU0N0hFWGd1THc2UDc5REJMbGY4RUlYVXpCRXFrTlZNUmRZOVlLbTNiYTBmVW5YTHZKakxFOXRnNWFIUEhJaFlMNXRDSWJnZHJPRV81Q0hJR29lTEVpU1J5dDBpeFJKNXlTU291am1lQXV3eVFzMU5SZEthckZSSHBNeXQtRTZvNVR1MUYzSW5GR09vQlBnck1HVlZrRlgyTzluOW0yMkJwUWlsRlFBMkt2eVVMV2FycXZBUExCRGladUlFS29pZ0FRVkU3Ui1kQkkxakJpa3dxeGtpVXpTbnpJTzRaemkxaDN0OUVLVjNiQW5uNmZPUl9vY0g1TUdUZmczby1SR1QyNHl0UWE2RXpGRVIySVhxT0Fqb2tORVluRVp6UERiNzJTdWpNQ0UtNk5USlVCYWVlMFVPOHhLQ25iV2JUbmd6alo1ZThlVE81UUJpOGRDWElRelZnZXpYTkRwaVRzMG8xU0lXN2Zlb2xBR3RXaHlfLU84dXV0M2tWaS1SSldiQ2V6MUFOdVU0anpaQ1lzdUU0V25vNDNhQWItM0lYU2JHMWgzbklhYlZWNWVKVFJsWlFOa2JRSVVMejlZRi1Rd2pZUF9RcXh2RGRTQ09mZjlSNHVpZDNuUVpxWjhsSTUwYnotcGpTdWVZcXFaOHNPSlNidnBvdk1LNG4wX3RGc3pDS2l6c0hBUWtQb2ptZkJCOGVQV3NNWmY2T201RXUybGRSblMyaGZhY1ZyUW5uMXVOS2h2YXdOWXBDMVhWN1ZEWHVaZmZlTWo0UGpScDZkd0cwSHpBc0ZIYmxlUGQybTdJbXIwX0g4aWdZMHhvSXdPd0Y5eDRFWDIzSFJfTDNlMU5RZ1N0R1RCcUxoR1o0empxSk5tVHgwNnVlN24zNmxZODQwZk4wRDVyS2RZdThJdl9XTEs4bUtxUkpkZU91RGxHNGxPX3dXWHlNTXBXck41bVViM21nR0g5Ri1TUll2ajJzMjJER05ncm5WODgtY1ZfVnlrVTF5RVFSTlh2RkdzaEV2Tk5wQUdpcGtMMnBzUW5zYVdTWW9ZOUpFcmJ4c0E2Qm9qcDBYS21IQjRtREdxRkR6ajU1Qzh6Q3Z4Q2UzTFBoeHdBdVhjNXpsOEtRbEJrZXBKc3ZUOVdwVmZPLXBuWkttemVjSTdCcVhDRS1EZWFGQmloSWlxSzRzMFZTX1V3Rnh0aVFzejlwZVo5WTc3MFpVNjdYSEJWdEFvVEpra1h1UU1UX090RkNiTUhQOGVUSW1pc0UxVk1oWXIxT05BbERPS3RQZVVRSDJYRERLR0d1UktXYWMwNEtOR3N5QkU3Xzc5b0dwSlF5UHRQV1pKUFBZRFFocmpYRXZpUEhSazdjUHp2R29xY3JEREV2NXc1TGxZWHVSRWFKR3dndGdHQ2xkS2R3SU8xS2w4TzlwazlhUUE3YVJuZ1Jjdk8yanYtaDhVYi1vYXhQZ2RaT2g1Ml9QS3ZaRVFjQk43YmdEd0ZVTTlCT0lsY2I3M3ZOemxsaEFxVTVFVGkzdHdxbjlRcWUwekJIbHNtTmNWVkVZd1RfOW1Ec1RrMjU4Mm15S2tFeDJ2eU1zazBpdG5XeGlpZC1lRlZrTHFNbE4xVFQxdGlUeUtBU0pndUhrTktpbkI0S0NGV29hNl8xTlZhM3dkbmFZdUVHNi1QQWxVVXJ6T3MxWWVuTHdiaXRlZ2ZLc1g2YlBacmhOcWNuRml4d01raHpWa3E2dEFwS09vUlAyQWJna3VuNU15ZDc2YjhfUV84VDNLY0ZQdlVKOUtoYjBOSUNkaFZYamcybEhaNmUyQTk3S3NsWVFhOHRUQkhvWVhGMTFfWlZ1Q1gwVUcxbTE3UEZCUHpIVkgwaHA3enRYRUdjbUpWU09KN2l3bThhd2hFTm1wbGVCaG1mdFZ0emVFZmFhZnZDMm9Say1tSXlqbU1Ga0k2VTFZRjdVMldHZ3BYLXc5M2JtTWFkWGgxTzVZZ3RrdmN5MzA3YUNZd0JBU0h5Y3JlYXl6WW5CdUI0aEF6d1hMZWlvOG90bEFscl9JajM4dzZWTm9Pd0NEWmk4ZWRZMi1aVzJrcHRxWGFMczQ2d2ZGVGJfTTR2cUViVDhaN2tmTnRvTXRwTGJ0LS1lQ2ZJV2pxeEtOa2Y1TDF5bnpnbEhEN0VIdXloQXo5SFBuM1ZyN0JqNDRGQXVVdVcwMWFqN25Td2Z1WmVXMDhWOGV4bGVmMURuSklPbG1vWTJ4MkpvU0R1Ym56M3NTeGZkaG5YdVQ2QXFoNFRwbHlBMFVhSlZuRXlSLTJwZENQYXQ3Qy0xSWZiWDJNZ2lBZVRfWDJFZ0FjQTdlTnNiSG9MaGtaUnJfY2txSTJKN21MTFN2YnlQbmhPZnRGUW4tQTJqNVZYZWpiWmVRbDg5TTVQVnUzSTZ4NWFQeDRLZmViVE5mbXVaTWpOT3BQYmZFdkxBU004dGdTMG1hOE9nOFE0a1dwdmYwZEN5RGEyM3V2MnluVmVwNmliMFB3a2ZwTkltTWR2NzBiX1pRVElaeE5YLVVFU1EzUEZ3QjdFMjg1bzNzOTczZ0RkUExMalcwWTVZODNaWDJTbGFYbE1aY1NiLWV2U2RfMlA1NjZkLTkyanNSRnBhT3hYWmlBWFBTamxRMjJ3SFVTdTRtTzBDa0N5TlVfcGNQQ1RObmFXRnNhYnhVVC0tWXk2d0RCbEtpSWthSUVPSUN3VGs0amhqUUdGdnM0S21XTWkzbFB6UDVaNWtvS0k2OUVjOVdfYjFpOFRsc0Jsb2JMcVRBamxiNC1GdVVDN1RaaC1TZVNVZWtJSFBwSWhWTFl3ZVJzMHV0MW1BWjk0Nk1yMV9mbkx6bDlSS3JuTVlEa3NNVHVKTjNCVzJJNU5OTExFUm40RXlmMk5yTm1zZ0g1OWg2UXdiMzE1QzdHUnZVaW9nNWhwZlZPMTVJZVNxZG1Dbjk0UDJTRG1oeVBteEFwcnh3V3l6azNEN3hyS3MzZWQ0VWwzakRfUGc5NWtBNUVqd0dKZ0lKUXp3c25iaHpPc1htQ2FvdEZFS01PSWs4dXktVmlSbUV1ODRsbkoySXkyVU12ODlVdUMxY3VVZXJsYzlYNEFZR2oyRE9ZUnVoOVlqTFBoVWZkQ1U4eW9fenBXdUhNa3ZiMVMySUhaNjNSWjBRbnZhb3ZLNm5DNlRTZ1JFcWlYUEJuMmVKaEZlOXpaRURiZnRWTkg0a2UyVHR6V04xc0psUFV1MmEzMEQ0c3pPT0s3TnkzUUJ1bTNXdE9UZ01BRUFLNjl1ek45ZXB1QWE2cVUySURURDN0MnhWQ2hUTWxCdDg4VURNUXJQbVJaaV85WXlDM243VXoycFpPaXI4cWhEUk9lQ0lqQnRnWUZ0aUFvaG9RNFk0WF9DTmdWd2hEZUJjZ0NXUUZrS3NTM0VQeHVsWE5uS0wtQThjcVlWR2F0RW40Sk5WR1NSSnNNUTNmVW9aZ2Z4N1hFQWNKWUJfMUtIOGtYS1pTajRoYmUxVXNlYWVFOU9mRjNhVU5CLXVGaGp4a09ZQlJ4RWhFT1VnaU1wQ1hvTnNKTkRsTFY1U0N1dDJvVXVIMVVBeDhQUXNZVUF6bkZNOGl6dkgzRkdGT3oxeHF3aUlPNWliQnZmLXZCQ2J1TlFHWHl1SXFHWF8xY0Jscm51OUNJNXg1SGFRT054SHhLdmNFbFM1eXhOTHdmSE1POEhkRWRhY0pYVUhwdjBLa1BMU3Nhdklfd0xLckM4bURjNjR6RkpmVVNuQzZBcUhtOTJzTnBubXJxOGhWTHlxQmZTbmxoRFNNcGJBSXhVYzBzYWhvSXp4SnVBTEZIamoxZ1dxSFUzdjRONXJmVU1BZThVYTBVY25aVWV0TW43ZWZNZEctaThLWTRpaDZaR2t3ekhraDFYbnVIWjc4Nm1KRFBQUDZGWTIwOURYUk5XcUlhNm02Q3BETXJ0c19SOXBjdXhXX0NpVVpvN01Tc0p5ckVTdVh3N3RFeTRtTmZwQzRqc0lKenJ4YU1FQWNpZC1Cc0d0aFBkektKbHAzZWFDenk5S0NnMnY4dFB2ZVUwTWJBV2RRQWtIQUJ2Nnl6RUx0VVMzRnpEcDNsN1hNWWtFdHB1SkZzOUJqTkZ5VkZQOVFYanhwRmRqd3kxcnJOZ0lKc1VHV2tjM3lUdlM0MlV2WnNtcDdTYUJob0NreGlaU294STV0Mm5WVFNaaU9UdUl2dEd0QmRWb0lfaWFrcEpUNXpnekdPVENybmdfb09XRFBhOFZlRy1SWm5pUDJLaWhKMFBtNTV0WXpISkUwd251X3FmTXVYVzNpTEZoVUtNN2RUNktRV3hUcEhsV0tFc1Y4aVdBQXBPMFZnZXcxMVA1MUpwLTlkdWhneldtVDVzS3pWSjhjQ1d2U1VYRHM2R3dkWTdYdFI5ME9vc1BXbjRDQWxGNDlqbDlCb0lvTDZvZEh1Zkl3VDQxMWlvOFFHbHZzd0VjNTlIYnRXWEVVdnNyR3Z5R3lCSTFJRkprSmp1V0dlZXpHVDlmM3Q4dkl1eXBmaFRrQld5dEFTZXZLTDhEelMzcEdIOHh1NkZ4NWMyYTdpbElhNWdPenZNYlZBRi1jLU1VUEoxZDNkY2RaMXo0Tm40Sl9OcndpOXpxcDlucWZobWtHajFZQk4weUNybnFWZTlFcklSd2p2d3RDemRrTTdoeGNiZ3hycEM4VXNibVBneVl0SGI4TW9Za3MxYU5Ic0cwckpVZDZSWUJlMkprblNCd011YmlKQ0hSV2tSNjNDYmc1MkhPTVVJRVExeUw0S25zblZSaEFNMzh5TldFdUpiWlozLWV1RUJxZEZZS21HcVBna25YRUlpSXJnS1IwMVgwN0hDNnJzZFp4ZDRwMjl0WHk5ZTZtYzFXbHhfbFREMlJDSE9oTU5UWDc0YllHQW8xbDh2RUU1ZEcyZTl0VUtrdGRValg5NHJlY0tqNnJvMk45VmhyQzVCdk1rOFZ1RUNvcmQ0ZUpYLTlkTzZHc2ttWXNkLUtiUy1LTHRLNThleHBZQm9ZSGwzOUFpUFR3SlVFSjBRU3ZIQThXYVdVMW1XLUswMkZfRlN0QVRzLTZjM2Y1aVlGRHhXNUlheTI1VXUydjAzUVhSQkFmOEN3elhkc3dPNklNTXhjcFpBWjBsbHFBR1NIdG42WHp6V2ZhNkNvZXd4ZXlua1VpeFNxM0ZNUlpaczlCSEFUN1ZlTnVfdlRqVWwySVNhSkhXZ2lNcXprVlVlaW8yb3lVRWt0eG85eERmTjRpb1VTNnBVaHlEUV9pSmtsXzQ3UjFDME1jcEE2WU5hRUoyUTZhNHNfZzd0RTB1OXhKM2ZBYTI4bFNBaDJ3Zno5dFdiR3FDOHBVcnlGdmIxWDZ2U1RnVnRVWlV1VFZvZ2VHd3ZaRW9mWjBsdjAyYUZJaWxUYUxNRm5ZT2x2WjBFWW4zZXo2WUgtSUltNXNUeU1fRl81ZHM3QlMtbFg5aEFlcmh4aEl4TGJZeDZDdzZfanMzeVJFWEYxU0F3anByWndkdjhVNFFrUGxsQWRfWWVPVlBPaG1BYWdPU2F5TzZIRzlNZnl2enBtbDBnNkhyZDNmUFZqNEJhS2plRU5ibUo5Y19pMmFBcDZ5YjRLQ0FRUko0ZmVuY0tHSzlQWFpHZ253V2RzM0dsSTNhLVFTaEJROTR2VEtaTlJiak51RURZRzBoalhESWx4RHVlTFFZXzJ4LTVMZndJZWNKTHpEUFp3cURvZEZuOVpJQXJxQVE3NTAtWHQ1WU1IbkdaajZCdnlha3B2OWxHbWV3ZENmNjUtUnBIMmtHNXlMdElHbWdfdWlFT05OU2habHJyanFkbXl3V1FNNFgyTEtUQ040SWEtaFYwc1B1WmpvcHJCSURiZ3FxSzBBQ0Q4Y0tNcDhkOF9Sc1dSOXNENjdURXhLbGFvRlp5VDlXOEJ0UkF6MnczT2h0eHV4N3NfcWtDVXJ1Zy0tMFV6dm05T0dvejNyRHVDQkFpa3l3M0t0ODUzdlZYSGJaWDFzUjlqY3hXUUlMb2xFOHZiMnlxMXhHN1dmSHN1M3B5Y3NvSE5ZLVV4LUpfVjhfd3ZnMEdFaVF3Rk5wOVJZZGxPVTF3ZVNLT1dTS0laa2tZLU5rNDZRNkcxdzUtQ2Z4bmVtUjl1SWdnZWxQSnJUTnFVbjVHYkdxMVB0ZkRxZkwtQ1o4bTdJc3JZTUlGX2MtLW5GVGctYW5mOFRvRzNTWUpJWjJQekJlUEFpeF94czdTbDBtVFdhSzRWTXZsc0VIODluamJMN2FRbEdVMUhNbENZYmpNbVY1VTQ4dXVza2d4RU1oallvMTBWY0JNZm90bmh3eU43R0hlTHBMLVpOdFhLYW9jNlkxWm5sX2JMTXhORXlWTWVuMGxtYnJvQm15S09nUmdvQmkwejlDWjdUd2MzVUNtcG5meUlCXzhEbDQ0RDdETHNvZkR4R1Y0REVueGM3UmhTTGU3RTlmbFBrcndEbHROTUN3R3J6QlZrTncyUE53T3lsV01QV3ZMdmNYeFpPSTllOURNVFBmSTM1S1pHUTFWN29BZWItRVhfS1d3blpTYzdqTFhGWUItQUNzSjBVakVCWHVJdEZNQjdlRlRKLWYwUUJka3I0RXlrbUVsRmtSTTctM21VdEZ6T1o5aUFEWmFrelhod21uaVBBIl0' \
  --compressed

What if we just hardcode cookie for the USER_TYPE_LEGIT_USER?

aciddjus commented 1 year ago

Google Trends in the browser submits a request with reCAPTCHA token. This can be a reason we get USER_TYPE_SCRAPER instead of USER_TYPE_LEGIT_USER.

image

curl 'https://trends.google.com/trends/api/explore?hl=en-US&tz=-120&req=%7B%22comparisonItem%22:%5B%7B%22keyword%22:%22filter%22,%22geo%22:%22%22,%22time%22:%22now+4-H%22%7D%5D,%22category%22:0,%22property%22:%22%22%7D&tz=-120' \
  -H 'authority: trends.google.com' \
  -H 'accept: application/json, text/plain, */*' \
  -H 'accept-language: en-US,en;q=0.6' \
  -H 'content-type: application/json;charset=UTF-8' \
  -H 'cookie: NID=511=XFlLBiX63uT_Z3MtZZcDi_qaxDIpYgCnUfralfFn4HMFnavFOeuwOejdfB_eQb8-awg_jwYANnr7dGFtK4830aAEsP6Z-cl0YxRY6L1-_Z6V2nw90m4i1VN-FpCQEWtusomgE0WfPOilk7k95hSxJbwnsdMCxVqguJLBIiIMuok' \
  -H 'origin: https://trends.google.com' \
  -H 'referer: https://trends.google.com/trends/explore?date=now%204-H&q=filter' \
  -H 'sec-fetch-dest: empty' \
  -H 'sec-fetch-mode: cors' \
  -H 'sec-fetch-site: same-origin' \
  -H 'sec-gpc: 1' \
  -H 'user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36' \
  --data-raw 'FEWyJzZXRva2VuIiwiMDNBRDFJYkxDcnUtM0JUMVpvbHR4amhCcTRHOEVEUGptRkd2Uk8xLU8wMEpIWk45S053NjVxWUJnS2JVMnhDUU8wc1lWY3EwUXpIRGNqRTVYZ2JySVgwRWQ0Uy1adC15dEF1LXFHVm9lU1k3ZjJEcXN5UDRDcTJvNmhxc1JudTdxMlJSbjIxWDN0dHVlRDBoUXVGbHNReXZGT1JnU3poUktGNHRkV1RzMEx0cElxVUFaaGxEUXpPN1NYUmc2bkM5WlJhM29Qa2l6UXFOdEMxSWFrVDBRclZwVTIzYW51emVaZFpQVFFQdjZ3bFNLaHZDOHBUZE9qcV92T0J0YXdfVjNOT3QxNGN4TTVwMHdKSmhqSERjMXBzY1hWUm56a3J5U2FaNkluVUxucUgzMEJOYkpVTTJIV0R2ODNaZkdOM3RZSUdxd2kwRzRzcnRELW5oOUFFVTNMUmR6Tlg0OWZmb0l2elc4UEF5a1MzbFF0LWJ5NjZaSzN3NzV4ZXZWS0ZSTEkyREtZTk5Md19XUEtYdG9Tc200N0JqU1RUYTBJQ0IzYXdUZlR5WTAzN3dSMWhaZmFjdGN4cEdkd2U1cUVGclFyYzhEeEF0TG8wLVdHUE9rOHJ5RHZIVzhiZGtqaTZma1RJaWlRRXJjUlRjQ0RfUnFHLXh2b0Z3czR0RE1vQlgtN3BKdVBKY2tmdUxIZWZzT3hzS2lIenhyMEJ3N014RDNadmFFUmhEa190clM5cWJibUQ5dGF3ak9OT1dkVk9sdE9waGN3S1dhbml0cTA5aE5ZdXpLRU1tMk5rajA1cFl3ZDJGODFyQldlVDRCdzdyQy1OUm4wUGxuOVJQVEVENElXbzZiUFJEaWJxNkdreVhCa3RBMmNYbzh4el96Tmp0RVZqeXZwSnI5ZkxoTDg2YlQ4VF9PalJhUW53dnp2MjdWVFM5UzZxTjdXRUdONnliU2JRSTZWYlpyN0g0Q0tjYTBJOUFqUDJManNXc29OaC1NUEFTTnJHSUFHQldDeFNJeUxzZzhITVJSVENYd2tqbmJiQXEwOUpuaFRBZklPYzhhb1R1d2x6UW9wRUdXR1NERGJzU2JEb0ZEeC1WU3lfN29Fd1RkVWpPUXVwWWJ3cWNrZXd5ZHFneVNJVk5JWUNiTlVneUxzZ0Z6eFVhWDV6VWM1NWRZaS1LbmhpeWljalI4Xzg5R2VMd3Njdi1uVGg2UXN4QXlNZkdZTEhOWnRaTmtKR3A5enUyWF9zUzFTV3haTTI0UTZfQWxPQzlHODM0UjhZWVgxc1hCWlBlSzBJdVBkY2tveXlEUWpHcDRNeVFrSFZUVjd5dWNsOWhtMnFETHp1UDBscXdCdUlURHVIRG1SOGEzLUJUa2tyN28wVlU3SGZHcVBvU2lvcnZXUmxtM0dVUE41WkpLNF9tMC1HczdDYUp0VVJPV3BUbE1UZkszbzRqS2VfRFZLb2Z0VWloZTd0djhjSWlaekxuVDM2Y195cmJqRGRYUVkteVhVVDM5TTZ2MV85NG50cXJKMk0yN1NnNktVdVJveGdKLXQiLCJBc3E1RWxoVW1qNGtfeHJ6aHBpc2VseTNGamtaenVXT2RHSWg4LXRhNWE2WHZpWjRTdUpnc3dWY1pZZmVQUGc5bFZpSHF2ekszX2Z3V1RoYXRUSE9BanlFM0VHb2ExYkpjTVFDdWsyc3J6bGE0dlNZZzZlMUZmaU1WTU91Qm9ZVC1PRjBLb2lHZ1phdkk1aURETkQ5NHE3MVROZnZubHVTeTBTMFV3MVpHYThGRHQxSDJSVUpCOWFDTkhsTzF1a2FDMjR4M2x0bzdsRjFLQ2tiQmxCQktOU1BQV1hNR2k1UlJfanJOZmFDeWxoVFJ6dHFFUjdnTDc4YkVKWW5tNEdqdE9QZWZ0WEJqQ0dVcTFDT1Q5T29mbGJaaklZT0lCMS15c05rSnhuRXI4SnMtSWFxd3piS2dOUXlPSGJRcnhISkt4TFdfQ0t2ZWhTQU02VE1wNXd1WVVUcUtWUzZieWIzcmd2X0k2WVBiZm1MalMwZjJUQm9QUEctWVV3ZHk3Uks4cFZ1MzhaUS1KT2JnT2hEYnA1eDVTR1FkTExPM0hDekZEMllfZ2N2emNkVS1Id0pFQTVBX0pkd2ZaWDNXZnB1dXZmd0hBWXVsS0t2dDEyNThWaGdtLTE1XzFnbVM2X3N0MExISGtlWmdNWjI1eDFNZlhod2R6eUlfR2p1b3RueUdvMEdMWTliMFlabzU5QkJETV9nVnVwQjhSaXptV2dWZDVHeHoxdmdNRlJRbDd6STB1NkJWSExHVm5DWmo4aEpSM09lcTg0dm9FY3ZCQlpwVGxCNG1iN09hZnk4dTRfWl9OZzV1SUR4RkRIR1JhaXpWTmR3WlFLc3c2czhRMml2dXRTUE9hV2huU08yRWRvX3BwRHdwMnFNaTlDRTIzOThCZFdDRU93NUFKeFNVeUxVdFB1Z1dBbTR3MUtmNWVEdHVzYWlQaV9VMndpSjVWdWFjYndtcnAyM29wbk12WEd1eWh5V19fRklwM19NMktPNU9pN2Q4TUxjdUhjRkE1RThEV2xvQjVjcWlIdUVERUY4ZlNtaXkwVEhiVkF0MTZtVWtNeUxlRTZ2dzdPZkppOWhURmkxcnR6MnpqSmJnWGtRWVVrbTBQTHVXNEkwQTItdnYzSXFKUm1qeDRpbmY3ekJrM3Q3WlA4cDRUeF8tWGQyeUJ4WU5HTHF6blJSck1VUjgybEdRZW5seTFCU2o1Y00yc0hhZHdCeFZHU1ZaU2Zfb1B4MjlSbXRUblNfa2hZZFhCU09ISGFCaGFkSlluUWRpMkxOenV1VWNtMlhWNzdfSjBrc0tUYzJpMHdRbFZZVjh5X05mMlY2Z2RkdFJyOElmYnJINmdGWnNmNlJHVko3OGpYSTlPZW5uRVdfRFhJN2NtS21nTUlqTFRqREx1aHF6Skp5N0lxekdwSDlRWld0ZUppT1hPS2pHX2RLTFdOU3V6V1Y1WXp4MXppM1NodUtZOThKQVIxSnh0bmlmNUVmRkx1S2FaYWZvbzFKaDBTZlZqdkNKZmNRcmhlYUtuLXhFTWs4QnZZRG9Qdl9TbC1pUm1zZjctMXNSUDV2eVpsR19CLXRCZFd1QjNqYlkxc0EtY05mTTZScm9NZU84YjVkVEY3aDluRF9rVHA2bWRoTGxjei1uR2RqT0UtclFOUElFVW5lQ3p4bmhlSzZxcWNDcXUwalpoQjNSN0Jad3JnT2pqTGlBVHZSTXVtNGp6bThhMThxdzJWVi1Jd3ZBMk9KT0FnZzhwVXp4YkFwckRJZnBWUmxNSGRtVGRxYVdyZWNZQW9YU3dyQ3VRSzh6bFVuc0VFamdIZ2plVE53aUNWV1lGeWJwNnFWblJzWmRPcllUcmQ3SzdTYnVlY1FqaUI3ZVRtTUp2NjJ0ZTh3M3BuVHY0YkY1NGZzdkk2ZlM1S0d6YXgwTmNCMWFELTQzcG9LMmQ2Y2FXS1l3bTJMaERLNGRDS3VCSURPd0NXNThyaWxHdU9zbTVXVHJMMC1sZzlzY0ZaMWQtZTFTSnllcUdyY1JvWEZjNG1yaklMRWNMQ09fMU1ZZ3JncWpYSDVubUh1clI5Ri01OWVZbTk4bUo5elg0ZmlXczExbWh5YTB3Tld2WktvaF9XcWhRSDJOVDNBX3R0YVNTNnZPR2ViajdVb2d1dmp2QXhmd1d3STlnd0I4Um04OTQ2LTA0S3FxdGJ0dEg1TEFORWdwUXl1VkpBSlR0NEIxamppMWZSTEZXNEx5dzJISFJ4aUJGM2ZZeTRWd3BZd3BSYUNvNjJpRGhpNm1wR0pKV1VZN0J1c1BSeWJWeE1oS0h5SkloQ0NIa0NzWmpWYm8yemc1WEUtR2diS0dFczFadTdzOXZLNy1NZ0tGelR2NkhjZkN1WUxQcWdCMXF0NFhoNDVNUWFJc1hhQUROTHJtWGVjelh5M00wN2NfTEs1TTVzakQ2Q042TjY1TmNBbFZTN1hCNXVqb1hrellPclJicVZuamZfSlZQeS1heWlrZnpvR3RCSFgtXzNlWUdyRS1yS3llT0xSRXV4Sk96eXZ4X2luZlhtdzZlaXhOWFNiSFo2eGQ5OXo3SFVMbGRNallBUF9Pb05mdW5JNUNLa1J2Y2NmOWgyRjZKbEF4QzBSQTF4VTZ1Y1NIRzFERkVHUlBYWXFKeEF5VmhaTHlSaHFJXzdMbHZhWVI1amJYQ3ppaENnN2FPd0xKRXFEeHI3YldiODBjUm9EQWZ3Q3lndzVNY1JDSUh3MXkwOURVQ3RFMGlqUHVnekVSR2Z0X201WHU0X3ZEdVVraFlrLXNPeURIVGRtN0xFODJhVy1iVmh1cGJMRG5jejZEWDROREZpYTVaYlQ5U29KS0JWRTJKTGdlWjdPMHoyY1BnODE1OV82eFNNSmpOemQwMXk5VEJRVUFTZV9NN1VSYnotWTZvTThHNlI0WnNPWDUydmFnY1o5Q3FMZG5jb1YyUzFMWGZibDllUTRCY19nR3A4dkNUbVNNQ3hZVWo4V1ktWTZrRm4wXzhMdkp5eW0yeFZFNVJHbVBSVk1RcEROZVp5YVdkS0RTZjJxOGwtN0VlLTg2ckJ4WUZFcjlucDVHZHFMci1vT1B1SUljY0xvb1d6V2NRWVVwZGRxV0RXVGgxOUhfR1RxV0RXakpXc2kyWV9wUVctVjBfS2pCUy1NbmlRUU9tQ3NaQzJ1c0FxUmhMeXV1bWxuT3pPcEtHSlZGazl2eGNhc0dubGIzZk4yRVhaSDJKOHRwS25ZNUpNaWd4ZUFFMjZxUUpHeEh0a05SR253R0RHOHBvemIxVTl1Sk52dzBHRnR6VnN3b2h1ZXZmdTNqWDNiNU83amg4STBMV1Q1R05TNl9CaFRYVFRJRGZKa0l1bk4yU1ZpUThsVFRqY0FlTXNnYVRrc0RnbmhCUlhmZmRTSVVCY1U3TE9EMTRMU3dkNnpxVHpRQzFRU1lfeXd4WWRIc3dOeDNqeUJ1cFU5Mk01ZFlBXzZLV1BJNnNYdkVyd0JGNjhmaEt6eTE2V1ZtX09IOWdCTVVtTWR6a2NGaHVGUkI0ZVozbkFXUDRrb1hwc2xpVEFRams4R3hfOTVzak14RmltQzMxdUh4SFZpTUtuX2xLMS1ldkN2Z2kzU2QxTlFYUk56S0tCdGZwNmZvUXBHVkoxX1NfRklMR2YycHRVZ1E5WFNVLUtNUkg5a20xOWhwNThhdnJqYzlRdEVIQ1QxZjd5VVkzQS1LNU16Y1BCbVEwb3ZPM0h4Qk1BbTg2SmZ0Z0c2ZmJlTW14TVRUVU9OX1lDcm96U0FsRk5feVhvTVMwMXEyQUZQVWV0b0Q2enJod0djNzFaNFdHcE1YR29Xd05UZGJQNHVBZXhROGhZZ0oxTmk3ZzJlaDlVbllKaDBiWUdqVlE1UWNYQ3o2SWZmVFE1d1ltcG11aENtVkNQQU8xWjJpZTVIMk5FQmVoVjZwWmQ2b3FIMXdEeURTSVJDNG41b2FWTlVfWjU1SzF2cm5VcFZFeHlIZEpKMlo4TWl3a21ZQjZpbVNrOEttY1dDVzUyR1hiVGtHSXdjRFhHUmxHbVRodWdkemdDTXQ4MW9JbVF3SkFIYmJ3ZkE1a3pBTklXUVNKNzZBd0x4UXQyVkpEeEpZeTFPN0tfaVZOd3d4UVpqNmh2eUEwb3cySkwzOEdneHF2RzlWeTdTRHVJSjNmbF9xYi1LLXI5RlJOREVOMjNSZG9JZjJMcjU0N0hFWGd1THc2UDc5REJMbGY4RUlYVXpCRXFrTlZNUmRZOVlLbTNiYTBmVW5YTHZKakxFOXRnNWFIUEhJaFlMNXRDSWJnZHJPRV81Q0hJR29lTEVpU1J5dDBpeFJKNXlTU291am1lQXV3eVFzMU5SZEthckZSSHBNeXQtRTZvNVR1MUYzSW5GR09vQlBnck1HVlZrRlgyTzluOW0yMkJwUWlsRlFBMkt2eVVMV2FycXZBUExCRGladUlFS29pZ0FRVkU3Ui1kQkkxakJpa3dxeGtpVXpTbnpJTzRaemkxaDN0OUVLVjNiQW5uNmZPUl9vY0g1TUdUZmczby1SR1QyNHl0UWE2RXpGRVIySVhxT0Fqb2tORVluRVp6UERiNzJTdWpNQ0UtNk5USlVCYWVlMFVPOHhLQ25iV2JUbmd6alo1ZThlVE81UUJpOGRDWElRelZnZXpYTkRwaVRzMG8xU0lXN2Zlb2xBR3RXaHlfLU84dXV0M2tWaS1SSldiQ2V6MUFOdVU0anpaQ1lzdUU0V25vNDNhQWItM0lYU2JHMWgzbklhYlZWNWVKVFJsWlFOa2JRSVVMejlZRi1Rd2pZUF9RcXh2RGRTQ09mZjlSNHVpZDNuUVpxWjhsSTUwYnotcGpTdWVZcXFaOHNPSlNidnBvdk1LNG4wX3RGc3pDS2l6c0hBUWtQb2ptZkJCOGVQV3NNWmY2T201RXUybGRSblMyaGZhY1ZyUW5uMXVOS2h2YXdOWXBDMVhWN1ZEWHVaZmZlTWo0UGpScDZkd0cwSHpBc0ZIYmxlUGQybTdJbXIwX0g4aWdZMHhvSXdPd0Y5eDRFWDIzSFJfTDNlMU5RZ1N0R1RCcUxoR1o0empxSk5tVHgwNnVlN24zNmxZODQwZk4wRDVyS2RZdThJdl9XTEs4bUtxUkpkZU91RGxHNGxPX3dXWHlNTXBXck41bVViM21nR0g5Ri1TUll2ajJzMjJER05ncm5WODgtY1ZfVnlrVTF5RVFSTlh2RkdzaEV2Tk5wQUdpcGtMMnBzUW5zYVdTWW9ZOUpFcmJ4c0E2Qm9qcDBYS21IQjRtREdxRkR6ajU1Qzh6Q3Z4Q2UzTFBoeHdBdVhjNXpsOEtRbEJrZXBKc3ZUOVdwVmZPLXBuWkttemVjSTdCcVhDRS1EZWFGQmloSWlxSzRzMFZTX1V3Rnh0aVFzejlwZVo5WTc3MFpVNjdYSEJWdEFvVEpra1h1UU1UX090RkNiTUhQOGVUSW1pc0UxVk1oWXIxT05BbERPS3RQZVVRSDJYRERLR0d1UktXYWMwNEtOR3N5QkU3Xzc5b0dwSlF5UHRQV1pKUFBZRFFocmpYRXZpUEhSazdjUHp2R29xY3JEREV2NXc1TGxZWHVSRWFKR3dndGdHQ2xkS2R3SU8xS2w4TzlwazlhUUE3YVJuZ1Jjdk8yanYtaDhVYi1vYXhQZ2RaT2g1Ml9QS3ZaRVFjQk43YmdEd0ZVTTlCT0lsY2I3M3ZOemxsaEFxVTVFVGkzdHdxbjlRcWUwekJIbHNtTmNWVkVZd1RfOW1Ec1RrMjU4Mm15S2tFeDJ2eU1zazBpdG5XeGlpZC1lRlZrTHFNbE4xVFQxdGlUeUtBU0pndUhrTktpbkI0S0NGV29hNl8xTlZhM3dkbmFZdUVHNi1QQWxVVXJ6T3MxWWVuTHdiaXRlZ2ZLc1g2YlBacmhOcWNuRml4d01raHpWa3E2dEFwS09vUlAyQWJna3VuNU15ZDc2YjhfUV84VDNLY0ZQdlVKOUtoYjBOSUNkaFZYamcybEhaNmUyQTk3S3NsWVFhOHRUQkhvWVhGMTFfWlZ1Q1gwVUcxbTE3UEZCUHpIVkgwaHA3enRYRUdjbUpWU09KN2l3bThhd2hFTm1wbGVCaG1mdFZ0emVFZmFhZnZDMm9Say1tSXlqbU1Ga0k2VTFZRjdVMldHZ3BYLXc5M2JtTWFkWGgxTzVZZ3RrdmN5MzA3YUNZd0JBU0h5Y3JlYXl6WW5CdUI0aEF6d1hMZWlvOG90bEFscl9JajM4dzZWTm9Pd0NEWmk4ZWRZMi1aVzJrcHRxWGFMczQ2d2ZGVGJfTTR2cUViVDhaN2tmTnRvTXRwTGJ0LS1lQ2ZJV2pxeEtOa2Y1TDF5bnpnbEhEN0VIdXloQXo5SFBuM1ZyN0JqNDRGQXVVdVcwMWFqN25Td2Z1WmVXMDhWOGV4bGVmMURuSklPbG1vWTJ4MkpvU0R1Ym56M3NTeGZkaG5YdVQ2QXFoNFRwbHlBMFVhSlZuRXlSLTJwZENQYXQ3Qy0xSWZiWDJNZ2lBZVRfWDJFZ0FjQTdlTnNiSG9MaGtaUnJfY2txSTJKN21MTFN2YnlQbmhPZnRGUW4tQTJqNVZYZWpiWmVRbDg5TTVQVnUzSTZ4NWFQeDRLZmViVE5mbXVaTWpOT3BQYmZFdkxBU004dGdTMG1hOE9nOFE0a1dwdmYwZEN5RGEyM3V2MnluVmVwNmliMFB3a2ZwTkltTWR2NzBiX1pRVElaeE5YLVVFU1EzUEZ3QjdFMjg1bzNzOTczZ0RkUExMalcwWTVZODNaWDJTbGFYbE1aY1NiLWV2U2RfMlA1NjZkLTkyanNSRnBhT3hYWmlBWFBTamxRMjJ3SFVTdTRtTzBDa0N5TlVfcGNQQ1RObmFXRnNhYnhVVC0tWXk2d0RCbEtpSWthSUVPSUN3VGs0amhqUUdGdnM0S21XTWkzbFB6UDVaNWtvS0k2OUVjOVdfYjFpOFRsc0Jsb2JMcVRBamxiNC1GdVVDN1RaaC1TZVNVZWtJSFBwSWhWTFl3ZVJzMHV0MW1BWjk0Nk1yMV9mbkx6bDlSS3JuTVlEa3NNVHVKTjNCVzJJNU5OTExFUm40RXlmMk5yTm1zZ0g1OWg2UXdiMzE1QzdHUnZVaW9nNWhwZlZPMTVJZVNxZG1Dbjk0UDJTRG1oeVBteEFwcnh3V3l6azNEN3hyS3MzZWQ0VWwzakRfUGc5NWtBNUVqd0dKZ0lKUXp3c25iaHpPc1htQ2FvdEZFS01PSWs4dXktVmlSbUV1ODRsbkoySXkyVU12ODlVdUMxY3VVZXJsYzlYNEFZR2oyRE9ZUnVoOVlqTFBoVWZkQ1U4eW9fenBXdUhNa3ZiMVMySUhaNjNSWjBRbnZhb3ZLNm5DNlRTZ1JFcWlYUEJuMmVKaEZlOXpaRURiZnRWTkg0a2UyVHR6V04xc0psUFV1MmEzMEQ0c3pPT0s3TnkzUUJ1bTNXdE9UZ01BRUFLNjl1ek45ZXB1QWE2cVUySURURDN0MnhWQ2hUTWxCdDg4VURNUXJQbVJaaV85WXlDM243VXoycFpPaXI4cWhEUk9lQ0lqQnRnWUZ0aUFvaG9RNFk0WF9DTmdWd2hEZUJjZ0NXUUZrS3NTM0VQeHVsWE5uS0wtQThjcVlWR2F0RW40Sk5WR1NSSnNNUTNmVW9aZ2Z4N1hFQWNKWUJfMUtIOGtYS1pTajRoYmUxVXNlYWVFOU9mRjNhVU5CLXVGaGp4a09ZQlJ4RWhFT1VnaU1wQ1hvTnNKTkRsTFY1U0N1dDJvVXVIMVVBeDhQUXNZVUF6bkZNOGl6dkgzRkdGT3oxeHF3aUlPNWliQnZmLXZCQ2J1TlFHWHl1SXFHWF8xY0Jscm51OUNJNXg1SGFRT054SHhLdmNFbFM1eXhOTHdmSE1POEhkRWRhY0pYVUhwdjBLa1BMU3Nhdklfd0xLckM4bURjNjR6RkpmVVNuQzZBcUhtOTJzTnBubXJxOGhWTHlxQmZTbmxoRFNNcGJBSXhVYzBzYWhvSXp4SnVBTEZIamoxZ1dxSFUzdjRONXJmVU1BZThVYTBVY25aVWV0TW43ZWZNZEctaThLWTRpaDZaR2t3ekhraDFYbnVIWjc4Nm1KRFBQUDZGWTIwOURYUk5XcUlhNm02Q3BETXJ0c19SOXBjdXhXX0NpVVpvN01Tc0p5ckVTdVh3N3RFeTRtTmZwQzRqc0lKenJ4YU1FQWNpZC1Cc0d0aFBkektKbHAzZWFDenk5S0NnMnY4dFB2ZVUwTWJBV2RRQWtIQUJ2Nnl6RUx0VVMzRnpEcDNsN1hNWWtFdHB1SkZzOUJqTkZ5VkZQOVFYanhwRmRqd3kxcnJOZ0lKc1VHV2tjM3lUdlM0MlV2WnNtcDdTYUJob0NreGlaU294STV0Mm5WVFNaaU9UdUl2dEd0QmRWb0lfaWFrcEpUNXpnekdPVENybmdfb09XRFBhOFZlRy1SWm5pUDJLaWhKMFBtNTV0WXpISkUwd251X3FmTXVYVzNpTEZoVUtNN2RUNktRV3hUcEhsV0tFc1Y4aVdBQXBPMFZnZXcxMVA1MUpwLTlkdWhneldtVDVzS3pWSjhjQ1d2U1VYRHM2R3dkWTdYdFI5ME9vc1BXbjRDQWxGNDlqbDlCb0lvTDZvZEh1Zkl3VDQxMWlvOFFHbHZzd0VjNTlIYnRXWEVVdnNyR3Z5R3lCSTFJRkprSmp1V0dlZXpHVDlmM3Q4dkl1eXBmaFRrQld5dEFTZXZLTDhEelMzcEdIOHh1NkZ4NWMyYTdpbElhNWdPenZNYlZBRi1jLU1VUEoxZDNkY2RaMXo0Tm40Sl9OcndpOXpxcDlucWZobWtHajFZQk4weUNybnFWZTlFcklSd2p2d3RDemRrTTdoeGNiZ3hycEM4VXNibVBneVl0SGI4TW9Za3MxYU5Ic0cwckpVZDZSWUJlMkprblNCd011YmlKQ0hSV2tSNjNDYmc1MkhPTVVJRVExeUw0S25zblZSaEFNMzh5TldFdUpiWlozLWV1RUJxZEZZS21HcVBna25YRUlpSXJnS1IwMVgwN0hDNnJzZFp4ZDRwMjl0WHk5ZTZtYzFXbHhfbFREMlJDSE9oTU5UWDc0YllHQW8xbDh2RUU1ZEcyZTl0VUtrdGRValg5NHJlY0tqNnJvMk45VmhyQzVCdk1rOFZ1RUNvcmQ0ZUpYLTlkTzZHc2ttWXNkLUtiUy1LTHRLNThleHBZQm9ZSGwzOUFpUFR3SlVFSjBRU3ZIQThXYVdVMW1XLUswMkZfRlN0QVRzLTZjM2Y1aVlGRHhXNUlheTI1VXUydjAzUVhSQkFmOEN3elhkc3dPNklNTXhjcFpBWjBsbHFBR1NIdG42WHp6V2ZhNkNvZXd4ZXlua1VpeFNxM0ZNUlpaczlCSEFUN1ZlTnVfdlRqVWwySVNhSkhXZ2lNcXprVlVlaW8yb3lVRWt0eG85eERmTjRpb1VTNnBVaHlEUV9pSmtsXzQ3UjFDME1jcEE2WU5hRUoyUTZhNHNfZzd0RTB1OXhKM2ZBYTI4bFNBaDJ3Zno5dFdiR3FDOHBVcnlGdmIxWDZ2U1RnVnRVWlV1VFZvZ2VHd3ZaRW9mWjBsdjAyYUZJaWxUYUxNRm5ZT2x2WjBFWW4zZXo2WUgtSUltNXNUeU1fRl81ZHM3QlMtbFg5aEFlcmh4aEl4TGJZeDZDdzZfanMzeVJFWEYxU0F3anByWndkdjhVNFFrUGxsQWRfWWVPVlBPaG1BYWdPU2F5TzZIRzlNZnl2enBtbDBnNkhyZDNmUFZqNEJhS2plRU5ibUo5Y19pMmFBcDZ5YjRLQ0FRUko0ZmVuY0tHSzlQWFpHZ253V2RzM0dsSTNhLVFTaEJROTR2VEtaTlJiak51RURZRzBoalhESWx4RHVlTFFZXzJ4LTVMZndJZWNKTHpEUFp3cURvZEZuOVpJQXJxQVE3NTAtWHQ1WU1IbkdaajZCdnlha3B2OWxHbWV3ZENmNjUtUnBIMmtHNXlMdElHbWdfdWlFT05OU2habHJyanFkbXl3V1FNNFgyTEtUQ040SWEtaFYwc1B1WmpvcHJCSURiZ3FxSzBBQ0Q4Y0tNcDhkOF9Sc1dSOXNENjdURXhLbGFvRlp5VDlXOEJ0UkF6MnczT2h0eHV4N3NfcWtDVXJ1Zy0tMFV6dm05T0dvejNyRHVDQkFpa3l3M0t0ODUzdlZYSGJaWDFzUjlqY3hXUUlMb2xFOHZiMnlxMXhHN1dmSHN1M3B5Y3NvSE5ZLVV4LUpfVjhfd3ZnMEdFaVF3Rk5wOVJZZGxPVTF3ZVNLT1dTS0laa2tZLU5rNDZRNkcxdzUtQ2Z4bmVtUjl1SWdnZWxQSnJUTnFVbjVHYkdxMVB0ZkRxZkwtQ1o4bTdJc3JZTUlGX2MtLW5GVGctYW5mOFRvRzNTWUpJWjJQekJlUEFpeF94czdTbDBtVFdhSzRWTXZsc0VIODluamJMN2FRbEdVMUhNbENZYmpNbVY1VTQ4dXVza2d4RU1oallvMTBWY0JNZm90bmh3eU43R0hlTHBMLVpOdFhLYW9jNlkxWm5sX2JMTXhORXlWTWVuMGxtYnJvQm15S09nUmdvQmkwejlDWjdUd2MzVUNtcG5meUlCXzhEbDQ0RDdETHNvZkR4R1Y0REVueGM3UmhTTGU3RTlmbFBrcndEbHROTUN3R3J6QlZrTncyUE53T3lsV01QV3ZMdmNYeFpPSTllOURNVFBmSTM1S1pHUTFWN29BZWItRVhfS1d3blpTYzdqTFhGWUItQUNzSjBVakVCWHVJdEZNQjdlRlRKLWYwUUJka3I0RXlrbUVsRmtSTTctM21VdEZ6T1o5aUFEWmFrelhod21uaVBBIl0' \
  --compressed

What if we just hardcode cookie for the USER_TYPE_LEGIT_USER?

I tried doing this. But it will still return USER_TYPE_SCRAPER after a few requests.

image
ilyazub commented 1 year ago

The request for cookie is expected to be a POST request now.

image

With the regular cURL, it's still returns USER_TYPE_SCRAPER. But with curl-impersonate, Google Trends responds with USER_TYPE_LEGIT_USER.

image

Command:

curl_ff98 'https://trends.google.com/trends/api/explore?hl=en-US&tz=-120&req=%7B%22comparisonItem%22:%5B%7B%22keyword%22:%22snowboard%22,%22geo%22:%22%22,%22time%22:%22today+12-m%22%7D%5D,%22category%22:0,%22property%22:%22%22%7D&tz=-120' \
  -H 'authority: trends.google.com' \
  -H 'accept: application/json, text/plain, */*' \
  -H 'content-type: application/json;charset=UTF-8' \
  -H 'cookie: NID=511=FJ4YkcBxxIqov2FykB9Bk59PRArkpNvtsUNt9YnMMQMjZ8_IVOILVqRP0CTaQbHav5UZ0XTeCbDpK8PA9niYtdiPlP8eNcB5pej0fp9gJq99jfFvzlB_dV74utZN-V2X_riUioiBhfwPdz16HbtA2Soxiu10lHPGdNlE__BYgoI' \
  -H 'origin: https://trends.google.com' \
  -H 'referer: https://trends.google.com/trends/explore?q=snowboard' \
  --data-raw 'FEWyJzZXRva2VuIiwiMDNBRDFJYkxBZ0pEY1BfYnVUZWhfdjJON0ZDSEFFSmdLZml1N0JTTEVnYy1wRmV6Z200SFFUOHhLQ1NIZGNSRk5sY3BUYUJTcE9fU3dLRUhpTDBPbncxR1ktMTUwUFZyY0pta2psaEJvRV9tMHlDaFFVZ1JYWFhTZkdzOWZaNEF3UEh1amkyN0R1Z0c5YklMdWFkLUxQX3FYYjlkR1RYbGZzYlpoUlhGQXh6dXNhU1dSYW11UEE5OEVQNkh3cG9DQm5NdTRNT2tHeE5GcXhuVWwyNlVTNEF1a2xlTmVBN3E0MFJYTldIbURlYmZldXBBZHktQmZ6SzVLbGlnbUxrcVVKa3lfMVBpeUprUndHSnVWUkpETVl1NmNwbjF5Rk0yZk1jelFvV3lWX0tzWENaTDZCSnNXSGdoV2lBREp3bzJON2xsaFR0ODRoLXdQeTZlM3JUZmFrbFRwNktaclRxMVBualpkY0FvamR3OF8zME9pU1hmY2swbzNMRWp6SnVZd3A0a3RHUnIzZEZtY0s2Y1hTUnF6bEZxcmdTV2wzdDNCU3V6SEJNbHlYbnFYeFRyMlhicnc2ckNxZUlEMUpTX2tIWkVJdlBlc2ZaZks4ekNwNGtMTDBiWGlSLTRJVlpmckRoUURzV2gxQlY2ZElJcTV0X2pUZ1hNR3dSQUNWQkM2VzZiQzR4a0J0MmJGUnNHM0NneEZPZjRfdVNGUDBYaTk4eFdLT05xS2MxMzR0by1qS0ctY1FZQUZTVV85d2Z1WXJyQ1lSWTRsZ2hWbW1HWm5sUTJ0c0RiQWRtTG5hQ0xJakh5MlBHNXpCaFdPV0pPdG10YjhacXRkN2YyVTB2cE9qcVA0blF5bUJ1ZVdUQkN5MW42aFVkYk1TVW9lc0tfWjhEWGFtV1lDVGpROE1rZ2Y0MkJxMDhqWWNWWUtTanIyQ2Z4QXQ3T0l3UFhWSFNuTVZIYWVRd2NxQVRvVXJuLUNWaExFTFRrdWJYb0J5WVhidHdMb2xORGFQemxheURKY1FSRWJwQlFzS0F5SVlMbURJRjRaUFlmdmlGcFY1TDNTTFVKcVRxcmdEWmlXQ2hwU2sxbzcyTGpLdDREWVJTd3R4YkttZTNOTkUyZGV3NnYtUTFLN2w2NTVKSmRKMlZ2R2Z3VlJiT2VXUnNMdnNqaW1JV1h2c0xNeFQxaHJKUHZ0VUs0bC05WlFablVTeGptQUZSQ3RqdFhyeTd1bWVmRHZWemtUeFlSWVZsaThaVFFUU3AyTDhyb2RFS1FPd19PNFdCbldCUkJ0dVVYOEpMNTdIclNwNkxaOUNNNmNCUUZxZWEzZ3FLWGxRbWQ2NEtOS29Ed2ZhV1FDeHJTSHVqalNJdEg3b3FRS2huQTZzQjExcUdlUF82TzdEeGdjc0tvb3ZRUnVuRFFBZkx0TWN2b1BxeXlNbDdSVEZLNnI4VkpBa1NXUndiX25yRDNTU2JlaTRIVmE1Q3R3OTlzTjlBeFp2aHVlZnY2eFpXR2s0LWJGRGo0M09RQTV4cjFMWWExS0o2V2pQV054Y1FPeWwiLCJBRnlxX0JlMV9FbkdmNHZIRi1ZNGRuWmlKZ2lRN2pXNTFoa08xWVdxb0RhQUlqM0V2QmMtajJwT2R5cVk0OVhsVHRVRW55UW5JRXBvNzdxSmdoOTRBZGpNZEtESGt5UlpQMlhfbG04VExIbVZzMW9GaUI4R3hBd3k2akljTUk1MVYyUEhzWGtpQlRVaW1IcFViLXFyUGRTVmdGZno3WFg3T0l5ajFVdmI2di1zZVRzdm1rM2VCakxGSkNJeXM2ZmZaX2hZRk5IalZLSHRfTGNxcXlzTHZfUmY3MS11THFoaTRzZnNzM2FnQWZpM2YtWnhQdUVXYU1OMjV1aE9ILVBhWWd5ZVE1T2ZJa2lCQzVkT3lPS3NoTlJIR2FWYVhMWmFkaEFhR1lMRlp3R3MtT1c2VmJWM3pwbWZZNUJmdFhSUllRRUtXZHRFWUEzNldWckpwQUlOb0tyZjlsX3I3WlZXR01Eakl1YXlBdlFSX2lFOUVscmZtTTg4NU9HaEpnemo0dVZFa0w5SUhWREc1SXJ6ZG44d0FzbHpnSl9idGdpcnRpOGt5LWpGZ0RQRTJtYk5fYnRmTmljLUFSeHJtMUNLNmg2Uk1iTmp0c0FBV3hEanNSbHA0dmwzSGthc3BwcXZfbDc2dkFQQktzTF9aZ01FaWhtSFJnVG5sYWtHUUwzXy1POUhqTTUxLXJuUGx2TVk5M3JTSXplUW55WGIwZU5tOGttS3dIQmNpeWY4cFpqdzkzMm9IYzlUVzlBdUJFRzFsQ3VhNUpjaU5iUmdzel92X0o0cjBWc0ozV1NKaFR4b3JQUDlwcm56VVFOakluOGNtM1dEUXY0Tk4yU2k5YUtjdFFfYVY0V2hlZE5kaWoxTGY4QTVaT05Ob045ODZkNDFVTDJ6R3d1cHhzTnBVczB2cmF5RGRMeXZKSjZkcmIxWFVhdXlYNktaZER6dDI5UXBTajBkY2FwX216R1FuM196Nm5EVDMxUjBlUVB0SDV6cFlaSHRJaXBJM3NlS0VmMWk3QjdobEVlSG1kbTFVMUtWNFM1Q3YyV08zOGhDRGJfeHNZMjVUaE8wLWY5Sy1qUDBTV1lXXzFvMnpDOVlJblRsa3lKM2hEclJaRURsdkdMZERsZkpSb0FmbHlOaFk4WTZONkRzak5SYWVZak5sSDNLenVDX0pLRjhUcmJSaEFQSkRibm5hRUY1a2NsTElYRlVsQlNnZXNqa2F2c0FUWENSdUgyMDNrakdRVFd5XzF2SkR3V0dvcDB0QnhxUkJycWJsMWY1T3ZJZmg3Z2dvRG5YODl1UHFLNXlRelBBZ1p3X1laWUw4TDRnV1dFZnEzd21UQXlqTkVjYXpXODhfNWdfbmlkMlQ1Sk5wTk16Q0FRNDExd2tHTWxwWHpwaWRfalNpWVFlX2pvbGh1YnFGMXBwSHZ4em5yR2ZjZmk4RE1tSjZSZi1UTlJhc1RXUVQ4X1hONl9fLWlEcmQtanBGMmFCWEJXRUk3YTNqSXBSYkc1ancwM25fM0s0MjZJZ05LZ0JtOEZQRDE4aC1wRzEwMUpBMG13NktpdW1KR2xjYVBpZVVBczFrdXg0bjE4aElKVy11LVhkVEpBS1ZjR3dVY1ZIaXZkMThWWGxEZFNhNklqQXlzQkVaQnByRG4wMmZuMnJsRWs3TEFSSXNvM003ckF3TVV6enU1aE83X0RFeEEzemFwQnd1aFRHSHRrSHE3UmVveHViY2toSjJaT1A2YUFaM1RvYWNQbzU1QUh3M3BZTkxaNDF3Y19zZG15cmNXemVVLTNUaVVycGx5TXVQS01Ya0FSbmxvYUxOcGw4SVUtTVVzZ21GRWdFaHFzMFdwSTE5RVZHeXBzVXJ3eGlGQWJKcHQ5WTNaTU5jQjlGQnpyRXpwaEdGRlFxMzh0S0xfZ3ZWLVl3LUE4MmJzOGhNdjZ6eHBSRm5ZWndpaWM4VVIwQWgwNzg2SWpyWmxrd2tpWEctb2E4and5M2NDODU3MzRiZ1JSMmF2YmRXeXNYVS1JQm5fNGx1M1QyWHFzd0NrZGp5QnptWU9VRDJUTEhWYm5FSmlPbFo4Mm1aRzREdFBFdUdTTVpzbWpzdmZJNUwzcWF5QXFwX1NOcnNxSVRGdHNCUVRKamJLUFVxT1FtWE9qU3RGYnpXVVZrZjZQVUhfVFoxbzZoazdTWnFwdHZZYWh6ay10LTBxM2xsb3F5UUFPZUxZTWlxNWhNY1dpZENNU2MzYkVORUJhemlzSUJFNnhrd3g4QXhhVTNqdW1UaTBTZVNhenZ6SThvTFBvVXNPTnJQWkxCdnBDczZFZUgxQmZPM3ZKS2s0WjBUQzZmdnBUVktLeXFhTElobXRWemxWREYzU1JDYWFwckx2Ylk0SXNrN0IydDVnNlRaSzBieG1jOFc1RHBySWZIN3dDQjV2VE5vVk5QaVcwbjNiZnNPSlc4SGVGczU3dFJVWFd4VnIydllqNWM1M3FRSWtXQ0Z0TWt3aTNyU01DZnVFRzhvZDJHcFFzbFFmWm80XzVLUF9QM3BVdVZhWTdJNDhwS21SeVFCWEViOFdod2lhWWZrTm5MWGltb3g2TC1kY3cwQkQtQ2pmRGxJN1cyTnE3M28xTkh2RnFpXzNZUndUOXhlWklRazZhbE92a3hpSFA3ZEhZeVUtdndlZXNuTHNzZG1McGpaclRiYVRZckNoWXNpNExMMktrQWFaYnhlbTFES09zMk9iZXc4M1hLTUxYcmdwZXZLaDQxUFpzX2NMSG9hWGZYZHNTZTl0Z1ZHMDFaR3U0SjJjZDk0MXNCdTE0clVrR3oxTktFUnZTakRjZnN1WnVjNVZpVGtGRF9RZWs1a0x3V2t3UzZWSjQycElhZzFTVVk1SHZFZEhDWFhweHJsdkQxWjVGWVU4dnpoMndKNE1mbUwtVC1jc25yM09pa01ETzNpX1BoQzdkSlpJSTYtX0lnVnpiUy1VcW54d0FkVE84QlR1bmlYNEVjT201bFhtelJLM1FqMmFUZXpNUzZUbUhsUEdabWdsQTF1ckNfUHlTQ3VWQ19QSXJKanBDSjRRV3ZpMHZHdE5janpHR1loTXpYS0VPbk1WVDJMaHZoc0ZONFUxWmJPYXlkdVlsclY4VnNFUGtOV3hXdDl1bm1xd1pwRTQwb0kzQ3UtRTU2RkFpSUt2UFhvaE5LVHdQX1B4aXM0U2JlalJnRDgxakJqZWpub0lyX0hVdHY5SklPcVFWeUN1OExyaWlrclZVeU9McHI0ODlpX21qLUVwZjU4SUNPcFJPRjE0V2tmQ1RjM2Rsc19NeGk2Rm9Oc0FTNGpfa21IUDVJaE14OGRpUE51SXBjM1JrZXFVamhHVEd3eFA2TkVEYmhTaWVwM3BraHd5d0hHY3RpcV9aV2Etd290bnVwNU4tVkZHd19mc3VWRTktd0VOWmFfRHdmRlRwM0VVTVA3dGV6VTZLRGtnX3gtcTFqSGpzelREMXJtSWZ4ZXBxSEVFcUFIczJscVZKOTc1QzNTYWFkVHE1UXJjRklMb09ScjdCTmh4a3k5NVdqTXhsQjNBZzQ5U3RWQlNXeG9nemd1eW5sdGMxcXdFMjBnck1NcklnOWNhd3NvTUZ2eFhxMmU1bzlIbS1oMnRsNWo5YnFSSlhTc0VRUjhYQXZzUmhpaWFDTWZfaWhIYU9fYWpqcldlUTBJWHVuQURob3MzbWVNUUNrRUhrQmtYdVAtZW16ZlRSYkQ5XzZVQVo4THQyZjBDaWVMNXYzakttVE96cEp2UWl5QWl2bkFsbnkwMTktUjFQRzNpdzZfRGszcGZ3TklpcjhpWF9EbzBoMkRJZUJtdUJkRVRndXdWSGtvckF2UXc5SHFic1ZkRUhBSWJjXzhYUFlBSDE2TzBNVi1GOGJMcm1UdXJLbWxMZGJQbFRrSzNWVGNpWnFsdjhibVNWOGwwUlVEbEphVUV2TEFIRzhZLVFPd0Rzek1sMXZUWlc5V0tyTEthSC1QSUhPck5NT2R0NXNNR1RHRDQ3WERJRzU4X2ZCbUhjRkVNWTNSQUQ2aWJhM3V6cUVSalRRblpKRWFDbVBfVk5ILUpPSXhGRHBQUzg2YlJ2aS1HT2FBaHBKU212RWZPMlNsX3dKLUxneDFHVDk2dG9FYkNhbi1KZlNORWhrRUw0dXJQLUJQRG9TZHdsMXdxRlhQVUhKZDFtNm8tUW82OXdJNFU2a0x2MTVaZzZfMENWMU5yZ016WnEzTG1pMjYtUWdtbGV2NS1OT0djYkZSNEdMNzdDQUFyQ3NaR1ZtUUhwc29YSVFQMkk0WWhtQUxWTlI2elFUNEZUU0pSV0RlLUdMT0paQk1oMDBJU0pyejJSb3NRbWhUWk1CNm5MQUdHeERienltcWdPRXQ0Wl9FN3YybmQ2Q2V3S1Z2aWpuMjJVSm5zMUxBUXo0dV90ZUFLcTZRUUtUYWMtZ3o5MVJTRFh5aUplYjAwdS14U1JHT1dnaXdCZ2tka3Ata1dfWEx4ei1GRkFteHRFangxaEFzNURCR0ZWR0dfOUFfc0h5eHZYVG81b2lHbnFDeWJWTnFvdFJnRHAwUUtoMnlGcEdIalZ2QXFoemtENjFtcm40cjY5ZmRBZWFIQ1pqa0lZZGRMM1BWSWJTcDBFd3h4bUhSY2k3Q1N2RUtaQ2NCdUxYTFdBS1dMd2Z1cGF6Rm8wOUJBWjYyTUJSRlRweUdXVVJLVzdrREoxWFBpSG5lTVA2WXlMY2ZoOU51Y21keGxseHJJSTNEQ0xXOGNhakNBZDctbVo4Uk1YRU9sSUkwcXR2dVhOMEFjMk1Oeml6NDRPbnZ4TGdyQjFKSGtmMm1jbzNFdHJXazV3cW9EZFBUeE81R2N6OHY1UHNSVW9vQklBbVN6M1A4NWtSMFkxX2xRMlZTaXg3OHBVcUY4YTg5dnphV3VFX09wdEVuTGQ4NzNHNTBwZU5uZmJkSWFIdnhfdy1rRlJVRndsVlBOcmhWMzhHU0g5NHVrZFlzUkNETEprVm8tdXAtUW5NRm1kdkM3M3lObkthVkNXT0dTT180dXFwMVVLc1MzWWN5eUsyTFBhVmtTZUU1eWxUYjRFZm40cl9GZ3VURHYxZWtKM2gyZHpfYmVVTlFRMXVJRHVYRkxPaDF0d0E2Vm56UGIzblZFYkstcGdSWTNmTDdfLXljZkhoN2JmdkdGS08wM0NEU2NQWEtQbTN0bWE4Qjl6MnF2dXFTM0FOdGxwVWlGanRtQWU4MVlHQkVUTzRtSDBCLUJwX0NNMDBLLWVLR3ZwaU9BbTh5cnVCSzAweG0yLV9IUHNlSi1oM1ZUcjBxZ3pJeGZRNkhtUnZnVE5ZWVc1bEpScFZ2XzgzRnhCVzJiOWNQNmR6U3FIQ090a2lfeTVXZjVhcDF6T00xUVlNdDBzZHJ2el8tMDRVREhybVowX25jN0FxNGNEbDdBYnl5bDVlQURUdjB6WXhFM3NzM2NKdEVySUFUUXk0YlNiTGZBTG9SUWdsV3pqdEoyTXdMTDdIUkNIUGtVejJ2b2xDb2VHLW56QXh3RFRFbnBzS2MyZ05aajRVenV2cnJnQnpSb1BYWXpqQjctc2ZTdEJSZkM1NG1Vem9YRGZqa1htSVIwRlFveUlaejN5SUxDRWt2ZHRpN0dfcTZ1blJhNG1yNjNiVTlxelM2VGFmTmJ4VnktY1VINTFQSE9rM0E4a1Z1QkVUNUU4cWlKbE93NTFZODJaM25CbFVCU3lzcEdUTW1WZXcwdkhHVC1sMmRlak1BNUJySUpVQTNKNlZBWGJabkw0U3pzTWVWMWdkYUlFdUhsRnBBRWlFQXhIVDlGSGRyVk1FNUF2bERqWlN5VndHUXVucFp2YUx6LWVPVlVjOHJieXRlYU1NN3AteDhxLVUwMzJlUjBfZWttLTdvcjl0S2w4cXJRWWk4MWQtQmg5ZGlMOUR5aGlEUndERmd5bGd0UkFwVVJuQ0ZWU2hSNmJlMnlSWjQtVWRSZHFWdkJ0QlNBcDFIMTRqR0JXY1JWb0lqb2dweHFzVldTOUI3OWVKdkVweUVZT0pudzVIVHdSeHktTmE1d1N1cHh1blJ1dFkwRkNkUmlYcWQySURkdXdvRm4zbWVGRHNLOEFrb2lNSmFkTmZ3Smx3bWZYU3dKRnhYd3ZrcW1pRkU2LTNOWXpKUkJiUlN0NVgtYXdfT0U0akNTbHU2ZnBXRTRiTXV4OGhHVmx6Ny16UzVPZzU5TU9mazZQakVuWWdOV2VaS1hVb1FvQ3duUHFwREUzdXFDbVNEUXpRNTlnTDZ0aHM2aEpNOFl2M0tWQnNPbzBGR0JCVnlwUjVndWItWUJNcTZTWnAxT0JjQVlnSEN0Y200SGdsRDlZNWg5UnZYM0MwakNyQzUxZUhpelFzTlhqZkJhSWZPQjE4eTY1TmQzWS0wT0QzQXBlYUlfM1ZFV2ZkRWhMRUlrR0NhWmFpZDJqUG5NcU1mQV9ZU2N6UFBEWXRmVXg2cWt3cEZqNFVqMEY2alkydzdrOC0tZ21zQTYtZC11dTk5dHZmLTVOeVNPU3RVRFVxcURCMWlpa1RQODdtMllGTDkxejRobExGbzcwQ3FPcXY5NkJ4MFFfS0RQYUVNYkhYelNLN2tmZHdsalJ5alJHd1N2QUpQVmdWeHg1bXoyS2xiYjdqLTBiNVE4T3dOS0xCZHdkWkdTLUZtVHZVUGdRQ01OUnpvbmZodXNtVmxzQVpraXI4bWNValNFMURzRXhqUTl1ME11ZVZzUzRjR3JyYUkycWNISVV2c2tQRjNZVDI3NmZpTWZ1b2tZaWpnWWdPTlo3MGVIaS1FT1k5aHJOY213czZVUHZXbi03YWdrSTVTWmE4SExPWHlEZnljNVpuQldhVXdnZDlqdDY5R2JXdHdhYVNqb0pQZU83cmxwT2VSLWpzRDhva0FtbmFTZXdfYkw2ZURGcXpTRTZIeHNqRi1sVkJHcW4xTURBbUcxY01aXzBNUVpVSWJDbFowYXVxMjJPLXN5ckotM3VIRDh1TjVYNDNGTzFRUkhZZFV0dDVMNDR4YzB3ZXN6WC12SHRoeWE3aDgwZnk1UU1icnFQYUotSzFPN192RldsOXJxQzJlU2Z2d0plTHRxRHFyaHJpZ2RXQkxEbjBUYXgxTzRzYTRiajZOVVRmYTgtczZ1MnZwTlFwN0QxYzgtOFd2c3ZqTmFHR1FyY3ljbDY5SlVwOVIteHBDb19Oc0kwLV9weGwwS2JZZG5YTWFiTGM4bHZOc21GS3Z0OHd6UVdQTGZLdFVRNENtV04zcEh5VVlWOGZCaDBGUGRmRktnWEFQZWdZLWJYZUpxLXBvejU3eW1nU2kxaC02eFh2bVc5QU9sVXdZZEwtMmRQMGtPNkNSb2M1N1gtbDYzR185Q1pObUFQdEdpbkVZZGI5VElrUXM0d1h3SFVRNk9VLVdaRHZPSEJGTkVyRkhpUlRuUWY1MXNibHlXYi0wQWtTWm1xd2ItblFuelIySXVxSEliZF94NnlvbUpEaGdHc1pxNUNPMTVYX0NNSzJMQWUybUJHT1ZhcTQwS0U0X002V2NzUmlJbWJaaWpBQUNUODljenB3TlZDc25nc1NvaUZQdVBmQ1pYbFNKUld4VVg1clJlX1NmdV9ZVzR3UWFSaTZWZ3JzUFItR1dJUUlKTjhPeTk1LUZTZVlxSUl4MFVjNHBMeDZ6emFCUkxPOWYxRjFveHZ2MjhVQ2xvSEUzTmVBaXhlX0JWSmlGS09uTXIzTHpuREdZVnd2LU9tS2N6V0FMQmpqNkFzOGtydjNwcG1CSHJGTVZ5VUNZZkZRdWlENy1yV0RoUlNOVWd1X0I5WDBHRWxRV2Z6VWVOVEJ5ejNVWW42eWF4TkVNZ3pkSlJYb3FvbnVjUE9qZkktckJlRFN5S1VWLS1zNXRyVEtBb3J5eHUyNzhNaXdCQTNWZzlFbVpLLTdtT2JzS01vVldzLUdFVFhIRTA2SnRuR0lmR3hjWTJCYWxBQThkektiME5CX0pVMG8xTXhUMFhsQ0hIY2NxNm5FM2ZBajZLTGNYaUVsN3dXZTJyRVNxQURqcHNSMTRjYmp1VzV6LThBXzB5RUlQZ3NaMnRBaE44X3hYNDUxTXhwWWN6WkxuSzhVMDl0dmJmdDVRWkM1V2MzV2N3Z3kzT1Zia3pqRVlXRkVQR29IRGViLTNpRzhsaGtLTHRCbVRJSENyVlFSQnlPZHYzWWtRSWk1NnJoeWI1ODlaZ1NYQU9aZW8tdUVNY09LOW5NU0dYR21VcXlKbXBTNU90R3NSWXlBSktyYmd5Z1N3NUtod0t3anJrOFZfUkhGSjFrYmg5a0tmMmhvX09wbVVwNlNxWmNac1NxWExnTlVkTmFPSk5Hdll2ZzFwa0I2SUZWcnhmR0JQNlV5WGZjSWNxMGRQUTNadFZaVzBLRE5ORGtsU3VVYVVtX0JQREo0MGljSEE1OVpDQ25oaHJjNG5qWTBsM2pKUTl6bE5Nc0c0NDJPNDVjNXRhMUJqSTUxNENwYTM3eVVHT09IRHRtMDRyazlIMnVZb29EOHdfQ0pMSEQ0VHc1XzJRTUg2S08xNmk1WmNuTDI0VlVoSktINWllV3dqVVQ0YW85UHRMelpZZWhBbm9VY3lpMjhxOE1UX2p4Qml6eEJjWEhFZ2FFZDVQTlFGTnJpeko2WnJxcHRjLWNUVmw0V0NuUFpRVDFxcUtzVWFka21JWVJQU1VBX015b0FLeGV5dmZTNjdlQzFGb0JqMnpyWDBUUW5fdTNfSFhxY2ZlTHE2Q3F6WDdvaWtSd05peEVESkhMR0JIYmVlNy1qRW1KX3lDazJfU21BNzdhZFRqYllpcHlkZFZHQnJKcU9hZ0xEX2RrZWNCbUVpQldxMzhQQUljSkMzQW80RTI1d1RRem5FOEZRMTEtZU1sYXNBalpiT1F3WVVKSGQ5U1VIYVhSMmdEX2Zzajd5djczdTNEcUVReHNrZ2RkQ2dncnVFMjVwVHVCSThkVUJDRjBjYjl5WWRwaVMtb0s4Y3VJcWNUTl9MSER2VGFmWEpaYlY2SWZYQjdwU0tNMFRKbkpWQUxPQko0aGlwLU1NOFRnLS1vRGdXSzZhbnZ4NFFqaU1GNDFOdmQ5MW9BZUFGSFhQZFhXNWtNVmpSd09UbTZ0RHhlcGNZSXlKZFlWZzhZUi1GOXd2aGFQa0NfOHhud2xSNUlhcEs0U2VDbTV2NUlObWdlOUR6cFhGR2VtcEZncWZ2WmlTQ1R5eFIzcTJWRS1ranB4cnR6bWxlZllwTVZKVzNhakItTXZFNW9EM3dsdkNuZWh4SjJuYzBhYXg0M3BYTGZOYmYwcUh5QXdHeWExbmRrakF0VVNRRkJwcWtra3g3emhUQ1dzdzFWMjF1MDcxQ2dQelJrblFxcGFUQmRQVzlCVF9qaE1LeFl6TG8wNVJKOWgyYllkRFpuQkoyeXV0Z3E4S3BGRmRlcmFQVGFKcEVzWGlaLVI3a1JweUhIekg3WTlaRXVCUXkyZGQ4ZWNFNkxsMW5VSjF6OTVDMDViTTFRcEFVa2FyS0tfakJWVlVRUVc0ejhqQ3hMenJHUGs4X1BnbmVzUGdGdUViQ0liamVLa19INURodjBnMEkySmVvMU8wR2lJbmVyM0kyWjZjb3NmR2Q2b1hJSEpzMnB4cHljdzNFMjA2dDlHNVlBY09rT2pZNnFFcVBXN2J1ay0yZVNVYVJ1YjFrYUpqYV8wSUs2OVZabnhHdnRIcmxyTE12emxuU3JlbE53N1RpS01mTjJOMERpdE1QR3NucFF3NVJvNWNzNWYwR0tvN2lfaWNHanY3bVlRWFhhUktaOGEzd21xMHNKazdtanlDYTc2TFpGY2hGOHMwOC1CU1huRGliWnVwb1ozb1NHLTBXbGFvMm5wbGdYUkp6TUctTDI2ME5pdmhmcEFSeHl2N2RBd3NsYlF3aHMtbE5rY2p6Z0c5NUNWZTVaY3RHMjV6Ujl3U0QzUXhseXVIbzBUYVlyOGdGZ0tTaG9MeDcwVk9MaHJpbzBlOFNZUzBmcE1HLVRYYXBrYVJvQl9iTXdNV05Ic3RUQWxoOXdqN05iUVlzaXU1QnNSbVZjRWNYcXo1R0pwWGNGVW1mZk9jSkF3b25pcGlIVWhCWVB0TXVXY2JJTFFkQ0F1MlpoQV9wdERGSW1JNm12Z0NLVnBIM291Y25rTi1yTGhLY0NmZnlXd0xweU9PRDJ0VmhqaGxsUko0RXloUlNlcWxSeTFtQ0pzbTdYdWNadXNvVHQ0YzNNU3ozTFNVVEFUV0RHOWZMTlU3TVliOEFXV0NCeXpQeU1QaE00dnYyN08wckg2bHAyNjBOR1FRNy12U2NkVk83NWdtTURqOFJrazYxSFBVMkdiUzIyQnoxSktrRzd2OGs4QXdFY1lSUWZGUS1rYmpSNE93NlNTMW1Za2k4bUd5bnFsM1Y5Sk9jaDZzRHBzWDRvNEF2MzJlTG5oVURBVm1yb0x2U29ENDcwRldSWjBmbWJ1MTZqVGI4VTQ0dXViaHM2TG85SEgwOEpQR21ZWEliX21xQ29Gc3VpcVdMc25UVzZHREh6T2JGcWk1M0JCRGNQa1V6QXpfcm5TYTRFLTZhUlVVbjVDdDVUZ3JrRV9TTDBZR21vQUg1Q2d2M0RRT2JvVkZFQlk4UzE1VmNrbEJCQUNORWNJbTlYcXRFQmY5NXJ0dlQ1UXc0OGNBdEdSdzZVU0ZjeW11N0dWVFhLcDk2cGUteWtEaml1VEJnTDN1M20zcXdGVXV2Ry1oendseHl0bG9JMnk3bVF0T3NMNWtNMzF5U0Z3bWJiZnlrdkNFOGVaUWhnQTlhVzdUY2J5bUxxd0I2Mi01WW5uRURaTlctQXdzajVFY0g2V3kzbVFsRTBjMVg0aGluWHQxcVJ3VWNnWDJweHJSdXk5WmEwc0N0NDQtOWxDd1BvazhfM05nTWtRZnY0bnV6ZV9OQmVtZkdyalZUNERGVmwxNWlWY3dVRlp6QkJBMkR4OHBtdTl5a0NRSnlWWXpUUXRiM3BYUVZEVTZxWlp6YWtUd2Z0ZUFJS216LUczU29KSV9VaTZuVHBpMFVOOWFFNHMySmpEV3FFUW5XYUJ6TE1NU3duZkF6ZWh4cTh1ek5hbVFSdXRKWmNYR3dkVmFhMU56Q2JOdFphVXA4cldoRzVNS0VMUU14Q2ZFQVZ2MnlDaURrZklCNGJOREpOSHFMSUFHVnVQRExCeHlrU3I1b1hoWXNUQ0ZIUm5NMWN4S0RQRGN2NG0yR2g5bUdURFNwRTl4VUk5NC1KMHZMS1RhMk9VVU1iTkxwY3hyNmFMV1ZLTUJOZmltbnZKMkhQVFUyNHQ3TEFjV1R1Z0NhZFdTYnhHMjF0SzBJeUx1M0tBZEZnNnNkcGVPaVZkdDdOdkdoM0xpTzlpR3BpT0tjbmNxbEM5ZkhlQlFaMzVxWGhNMmM3cU5ZbG1JcXRVMFJIbDMyUFRRSE43M25jcXlpSU9tb1VFWHlkcWZqakRYTVhzVGktcjNQVUdSTzVScVBUMVpzclJHenQwNE1vdTFFZ0c5Wno5dUNRU3hWUnFaRXVKdlhRWGNvOXlDNTNLQVZfSGN0UXNwdnRHcDY3QUJMSjcyZTNqR011S29WYXZQem5hQVROMTcyWTNTd3V0Qk9DUFVsRG9IdXEwVmhiNndESEFyV1prYUdqNlBpUGZuNVNjcVEzaGM5bVBkdDV0UXd4emh6UElvdXdYZ2ZUWGFqRVFOcll6R0FHMEowYnFDemlfMmVqOVRzLUpaZS1Fd0pudXRqQUxOZ3c1VFg5ZWMxV1U2Y3A0Z2ozZU16cEx4bU1UM3RPazJIektZS2JfZWd3ejlfblJZX3lnM09ISnliVWVIbzJmTnQtT0gzUXJrOGR0ejFoeFJGYWVhVmE2cGZ1R0o5WXV0dk9hRjJoMnZJZnBPaFlKeEhUTWhsZnZYQWRjVVFSY05YTUNhOHhuYXYzMy02ZTYxRkZlbFduUGViaDJqV2g1ZkRZYngxRGs5RGM5YkljRmJTSHJ0ek5SNm5CRWFaS2NTQVZIS21tampVcXV5SlNqT1dZNGtsVE0zc2ctYnhjb2tSYUhTRS1OMnh3c0VhcG1laGFwWElic2YwTS15bFNMZ1FWakFOd0FEZVBxdlY4eEdNT3plWlpvQ09jRVJFMS1Pck9lTmlaLTBJaVotYUJjWHpfX1JOUGZvV2hQNzJLVU1kRk9LS0RucF9qVXZnZUZhQ2s2R2tFdVRoTDZ4MHUzOUphcTloVlRtS3ZqQlY3UjZleUZQSGk1b3V5T2c1N3VQYU15dWVnYjNSWFdrWUlSVjJkUWVPOHRwRGNNZjdYbW9BN0RtbHNXM2UxdlZfbDlxaThlMmstbHJpZ0pPQktJY2pKaFFITi11Umw5ZElnZ2xyVFJNVUl0cURldGZPaklfSUM5U3VyTXA1Q3RmZTlEZHNjZU1iamMyeDFDTWVsUnR1OE4tUHM3S0E1Mnp0dVgwN3pEb090c3QwQjJMbEVDbl95MTVVbjVOMG9BS3BVZ3ZPZEw3b21zRHJKSzc3aWJiQkpPTEFwTjNpNEdlTXpQWTVia29PSDBwQmNIbzFXR0ZpQ05qNmdmd0M5ZDh5S0hFaWtuSjI4NDU3eTZnTnlkOWxGUThwOXJnd2lYZFJEOTJ5SUt4STlHTXp5YVNlWDhCdWhnNE1Bendkd3B4emp0amhtbFZYTHM4RHRXQnFUQ0ZmcUlrd184WW9pc29Na2lTOF9VVzFqTThnZEtZOG9OQm92M0phdldqb1JxUnhHdkZjbUlJOU8zNENiZThGcEQ3cEdZbEtwVTFMT05Ub0lnZHRrSDVDUVJocXR5MG5aTDFKdUxaOGJDTG1Sd1hlSnE5Ukp3VTNRWmhOWm9XdU5Ua0lrSnVJOWYzNTJhRWlzOG1vQkowNXU3dTFnMEUtbU0tQU1FY2VPTGtSelU3SVNPZjdxMkctQVMxTVhUeHlrUjVDVjluSUR0WHBrMUcxZldTaEFsaXhmLTBJZHA0WFhaNDJVaG1EdkI5WS1HVVdvYktKekliS0Z4MXVFQ0dBOEVpXzFqcEk2cFJ6cVhqRjNFMDVCaWczSmN3YzhBcS1Vam5CdDVJRjlLMDliczI2Ump0VVpuWFNtd1VqOVBpYS01Q05PU0wtUkNKQ1phZWtzaFFVSUF0OWlWTzVCa0ROeXhXaVdjaFR2VmJWT3pKb0VvT09HMEJ6TUlPTGFrSldiU3A1eVg4aUZNd3FMNktTZzg0S3hIckIzMFhBUEJtZWdKNXlWd3FmZXZET19uVXpMeVJYSDc3bXNObjlFQ1o1QzlsVlc5T0p0ZWpXQlF3RFhhZTY2Yi1jR3lHWDItMkYxNDl1RnVQTmNPa25mWHhBVXZaTmJ3SzhfaGZLWWhKUVZfa0gxeGw2U1ExWGNLTG5pRU9ac2VWNXp2Z0pyODB5alBqMkItLXhsa1hLaTJaalRuY2s0UEZOSHh2OGVPT2pEd2t4SkFubUp1ck9jM21BUGY4TEtJRVNqeUFLM0MwUXZuM1JUdEk2V2hkWElqRlM5VVdmZUo3Tk5UTzQzOERSVWVhakNiVDFacXpHNWdNXzdhUlBXeUFvMmhjS3lEVk55eHVkZzdURlRQVmVZX3ZkemhranBxNjZsOWlnV1RHVm9RUGE3cXl1V3BTRjZfWHhueDFPQXRhYUMtN3hvQTlKLWNZemZTczVLbXpkY0swWTNJZl9yc2tvdjdoc1I1aTRtMHpSRTBiZlJhakNpX3J2OE1lNU1zQUVsMFFrNWJnaWoyZ2kyT2VTSDdTUlBsS0VheG5ONFlRIl0' \
  --compressed
jbnitorum commented 1 year ago

@ilyazub is curl-impersonate going to be integrated into the product to make this work? I just tried in the API playground and I see the same issue is still persisting.

image

ritu1337 commented 1 year ago

With the regular cURL, it's still returns USER_TYPE_SCRAPER. But with curl-impersonate, Google Trends responds with USER_TYPE_LEGIT_USER.

@ilyazub I get "userType":"USER_TYPE_LEGIT_USER" with regular curl

curl --version
curl 7.84.0 (x86_64-apple-darwin22.0) libcurl/7.84.0 (SecureTransport) LibreSSL/3.3.6 zlib/1.2.11 nghttp2/1.47.0
Release-Date: 2022-06-27

I think we can reuse data in POST request to get USER_TYPE_LEGIT_USER, but on subsequent request with the same data you get USER_TYPE_SCRAPER. But if you wait a bit between requests with the same data then you get USER_TYPE_LEGIT_USER.

data FEWyJzZ... looks like a Recaptcha token.

ilyazub commented 1 year ago

data FEWyJzZ... looks like a Recaptcha token.

Yes, it's the Invisible reCAPTCHA token.

@ilyazub is curl-impersonate going to be integrated into the product to make this work? I just tried in the API playground and I see the same issue is still persisting.

@jbnitorum We will fix it but don't have a timeline for the fix. Thank you for your patience and understanding.

emptymalei commented 1 year ago

Hi @ilyazub , thanks a lot for looking into this. I am wondering if there is any update on this topic. Thanks.

Update: Please ignore. I realized that there is a more recent update here

887

ilyazub commented 1 year ago

The data from Google Trends and SerpApi seem to match.

Google Trends SerpApi
image image
https://trends.google.com/trends/explore?date=2017-01-01%202023-09-13&geo=DK&q=vink%C3%B8leskab&hl=en&tz=420 https://serpapi.com/playground?engine=google_trends&q=vink%C3%B8leskab&geo=DK&tz=420&date=2017-01-01+2023-09-13
Helldez commented 11 months ago

Any suggestions on how to fix the problem on the code?

ilyazub commented 11 months ago

@Helldez I'm sorry to hear that you faced an issue with our Google Trends API. May you please share a search ID or the parameters you used that caused the problem?

Helldez commented 11 months ago

I'm not a serpapi user I'm helping rewrite pytrends. So I wanted to ask you how you solved the recaptcha problem if possible otherwise thanks anyway

tanys123 commented 8 months ago

This should be fixed after https://github.com/serpapi/public-roadmap/issues/1143 as we are getting USER_TYPE_LEGIT_USER for our requests.

Screenshot 2024-02-28 at 3 44 25 PM