apify / got-scraping

HTTP client made for scraping based on got.
422 stars 32 forks source link

proxyConfiguration object #118

Closed sabatale closed 7 months ago

sabatale commented 7 months ago

In the context of using Apify actors, is this the way to implement the proxyConfiguration object?

We sometimes get The proxy server rejected the request with status code 590 but got-scraping seems to accept the option nonetheless.

const proxyConfiguration = await Actor.createProxyConfiguration(proxy);

const response = await gotScraping({
        url: host,
        proxyUrl: await proxyConfiguration.newUrl()
    });