search

sudheer-ranga / aliexpress-product-scraper

Get Aliexpress product details as a json response including feedbacks, variants, shipping info, description, images, etc.,
MIT License
232 stars 89 forks source link

Does not work when runParams is empty #47

Open Azshurith opened 3 months ago

Azshurith commented 3 months ago

image

I used your webcrawler for a couple of days and it was working, and now its starting to fail. I checked the source code from the puppeteer and it seems runParams is empty but the page is loaded successfully.

picli3 commented 3 months ago

I think aliexprees made changes to the page and there is no longer access to this function or it does not exist.

picli3 commented 3 months ago

image

That parameter is currently empty, I made the following change:


    const aliExpressData = await page.evaluate(() => window._d_c_.DCData);

    console.log("Data:",aliExpressData)

With this, some basic parameters are obtained.

tuvuanh27 commented 2 months ago

Has anyone successfully resolved the issue where the AliExpress product scraper fails when runParams is empty? I noticed that modifying the code to fetch data from window._dc.DCData was suggested but I need more data

picli3 commented 2 months ago

Has anyone successfully resolved the issue where the AliExpress product scraper fails when runParams is empty? I noticed that modifying the code to fetch data from window._dc.DCData was suggested but I need more data

As I said before, Aliexpress has changed their website to prevent people like us from obtaining this information.

LaszloDev commented 2 months ago

Is this library still considered to be working to scrape Product Reviews? @sudheer-ranga