search

FlyingHii / laravel-web-crawler

0 stars 0 forks source link

Crawl data #1

Open FlyingHii opened 6 months ago

FlyingHii commented 6 months ago
FlyingHii commented 6 months ago

curl 'https://shopee.vn/api/v4/recommend/recommend?bundle=category_landing_page&cat_level=1&catid=11035954&limit=60&offset=0' \ -H 'authority: shopee.vn' \ -H 'accept: */*' \ -H 'accept-language: en-US,en;q=0.9,th;q=0.8,vi;q=0.7' \ -H 'af-ac-enc-sz-token: uwg7EPPN/RHZD25zCsif1Q==|eFWsXI9zdmhIcfFJIFXmfB+HQfieo49Oe+VxhS8GjAd2PsIW4euMZlVEdbI8yykfJrvPO9NU7uAPXQ==|7wSBK8De6mbrQ6P8|08|3' \ -H 'cookie: SPC_F=WbEY4XkKjbEE7cfyNvw7FtjGLyWEeDYX; REC_T_ID=39c111b7-7d19-11ee-8fa6-42fa76e37180; _fbp=fb.1.1699327703346.2141083655; _hjSessionUser_868286=eyJpZCI6IjAwZjdhYzUzLTZlNWUtNTIwMC1hMWFhLTJjZWNjMmUwY2U1NCIsImNyZWF0ZWQiOjE2OTk2Njc2MjU1NzksImV4aXN0aW5nIjp0cnVlfQ==; _ga_M32T05RVZT=GS1.1.1701672345.4.1.1701672658.38.0.0; _gcl_au=1.1.72212707.1708080466; _med=refer; SPC_CLIENTID=V2JFWTRYa0tqYkVFxpprsmjnijurcltj; SPC_EC=.ZTlDa3Btd1lscFVvVW9QTRJGFZEkv6ZCY1Va6lInMx13p1upbuxPvguq0ir9Xj2Urs4LoJ30EceHzgENXAyYlKNfdjNcdAzzgtyqYDxOBzV5sIY6hQpp87cJxQkrtZ0jV3B2TTHeGcONmrqYLDxU2ylVS+cAMsn+lFg3SlRBN1DZLn57nRicE4aGj/JQu4E2JV55xXparuX/LSCFLB1ZqA==; SPC_ST=.ZTlDa3Btd1lscFVvVW9QTRJGFZEkv6ZCY1Va6lInMx13p1upbuxPvguq0ir9Xj2Urs4LoJ30EceHzgENXAyYlKNfdjNcdAzzgtyqYDxOBzV5sIY6hQpp87cJxQkrtZ0jV3B2TTHeGcONmrqYLDxU2ylVS+cAMsn+lFg3SlRBN1DZLn57nRicE4aGj/JQu4E2JV55xXparuX/LSCFLB1ZqA==; SPC_U=39211051; SPC_R_T_ID=TsljYZTUlzf6wfSWQkCqlIg6g5HsbzZQU14mOPrft//MhQvzAyRyTF1MRNjtTxT8yqvcYvkprU8tBXtdM6erQ7xMrLPF6rXrYRdl35mz9SanttkxGT1I2ZGjHsBGKK3MxG+RW94Bmd/wPKkLRwYmbzftdlekjdlVL8QzX0mRN2E=; SPC_R_T_IV=YVJlSkRQZWRTencwT1AxOQ==; SPC_T_ID=TsljYZTUlzf6wfSWQkCqlIg6g5HsbzZQU14mOPrft//MhQvzAyRyTF1MRNjtTxT8yqvcYvkprU8tBXtdM6erQ7xMrLPF6rXrYRdl35mz9SanttkxGT1I2ZGjHsBGKK3MxG+RW94Bmd/wPKkLRwYmbzftdlekjdlVL8QzX0mRN2E=; SPC_T_IV=YVJlSkRQZWRTencwT1AxOQ==; __LOCALE__null=VN; csrftoken=NiVlVqRhl6OgW8yyqabj5gFfNeOuvYVt; SPC_SI=CFPUZQAAAAA2Q1RIM0xDc89T/QEAAAAAY3h2aXBWbnY=; SPC_SEC_SI=v1-c2FrTVlRWUc0dkRvTzVISMBsS8Qrp90nunV0QAr9NjY1buHsN14/p45DemfELX1+jWhQ4N+oWMZ+djCo11osQKeUrRqrNUtJmy6wV58uRzE=; _sapid=46515efe6697d99b58424d3f4cbe8932bc211755e050b4d9db38634f; SPC_IA=1; _QPWSDCXHZQA=dfadb953-6ec5-4656-bfce-5b6ace4a3a20; REC7iLP4Q=e4735c49-a815-4c55-ab97-e187082f6517; _gid=GA1.2.1635048713.1709563046; _hjSession_868286=eyJpZCI6ImI1M2FjY2IwLTcxODctNGM5NC04OTliLWY4MzhkMDYzOTlmNyIsImMiOjE3MDk1NjY4MDYyNDYsInMiOjAsInIiOjAsInNiIjowLCJzciI6MCwic2UiOjAsImZzIjowLCJzcCI6MX0=; AMP_TOKEN=%24NOT_FOUND; shopee_webUnique_ccd=uwg7EPPN%2FRHZD25zCsif1Q%3D%3D%7CeFWsXI9zdmhIcfFJIFXmfB%2BHQfieo49Oe%2BVxhS8GjAd2PsIW4euMZlVEdbI8yykfJrvPO9NU7uAPXQ%3D%3D%7C7wSBK8De6mbrQ6P8%7C08%7C3; ds=bd7d661de92c49c496498faa2f9a2d00; _ga=GA1.2.169398553.1699327705; _ga_4GPP1ZXG63=GS1.1.1709565929.10.1.1709569740.60.0.0' \ -H 'if-none-match-: 55b03-accfa08e0cb763c78408fba204a3c4bd' \ -H 'referer: https://shopee.vn/M%C3%A1y-T%C3%ADnh-Laptop-cat.11035954' \ -H 'sec-ch-ua: "Not A(Brand";v="99", "Google Chrome";v="121", "Chromium";v="121"' \ -H 'sec-ch-ua-mobile: ?0' \ -H 'sec-ch-ua-platform: "Linux"' \ -H 'sec-fetch-dest: empty' \ -H 'sec-fetch-mode: cors' \ -H 'sec-fetch-site: same-origin' \ -H 'user-agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/121.0.0.0 Safari/537.36' \ -H 'x-api-source: pc' \ -H 'x-requested-with: XMLHttpRequest' \ -H 'x-sap-ri: 60f8e565656f50eefd8d0133030172f4ee6504534d89ad3452ae' \ -H 'x-sap-sec: dvBrb2e1+73UM73UBa3FM7eUBa3UM7eUM731M73UN7MUM+ZVM73tM73U+Mq+11ZUM76JMa3UG7cUM+mqu2qlnW75kWoeuxxZi5sa9buvboO4wq36FwRB3f3hos5nHy2Vtwl5SRSeOrPewwVg/U7NH6fo8l7/usmi7gmCrM6awGGm9bdHmL4mebkjMj3STodGwBDWDr7MsNGmrr7+r3/1W3HwCNlimwgCR1HOM0MPov0264v6EFRAhW12EvkvS+dUAIM2eaCkipWIV/br+dPSAi865GzvX3UHdDV2aK6AFs7LkdrxwDdWwNWehIaCrv3r/CDNYINf/u7A+7YpXwZAZhakD7DA9Z/onkG+6OB+ffhSiiCl8yy5cssuF6PT1bVmMj4XwQ8fcmu87R4iL7L2DSpapA1nHx8RqlwNQpKCVv1w8UK5OQv1nmkfMu90VpeVZUQUJLjs278doRUKbJe3I1dGFppJiSg5V+Cpd75UkERpG9I/uPeUvj5ZQIeBteZwhbigiLa6p4UcUawmtaMu8o1Cq8qhBUWK7Pk3mWFotQ0vRtprdeZBpUPHx/mUFj8fMyulvruqRMPXS2zcrufTPALNSYkUW+bVnhFbLOC3kEpmLQ3sZ9f1Jw7GOPlPtSr8uqSB7zkiVacVc0iE4D+oXm4v7QEzoUnJu4kmFVZpHWO/tdB/Fq1B/ifDy4PQJyhmGtF/OTO4vqppq7KaFe09V91FTiDwmVsicihG/08KeTMUrzMSNRC7A7rvrpq20d/kverfZVQl3nsmqRQbU+ZZXBXH8Te2k1p/9rupoBAtwPpeN8yq029lRe7LwO2Ri+PgR7BfnIqXD+t/RJH2gSttfyo8VgVTUbYvPASf22Sp17T0TEJXtj440iatMWlvI/Dk+9PDdn+jRTXNiqfZOjqMIC7SC8myzeNigHoujJIBMleATxDlCtaiRp5oj475KUc04gU28ZqsCnnugSZUM73LhU/h63L03a3UM778189+N73UM6UUM73GM73UKo3ntU0ux3Sm8+L00otfnSoeiWmFM73UhUP2/3e7/sMUM73UN738M7ZUB73FM73UN73UM6UUM73GM73Uw3BQQ/jPDLNLyEUFkaqy9DYk57hFM73U/nss/UKEs3LUM73U' \ -H 'x-shopee-language: vi' \ --compressed

FlyingHii commented 6 months ago

https://stackoverflow.com/questions/59557071/how-can-i-crawl-the-product-items-from-shopee-website