How to use

[herol-gl]

Could you provide a sample code on how to implement it in Scrapy spider file?

Thanks

[tubndgit]

Hello You can add this custom setting to spider file

class SampleSpider(scrapy.Spider):
    name = 'sample'

    # Custom settings
    custom_settings = {        
        'DOWNLOADER_MIDDLEWARES': {
            'scrapyx_bright_data.BrightDataProxyMiddleware': 610,  
        },        
        'RETRY_TIMES': 20,
        'BRIGHTDATA_ENABLED': True,
        'BRIGHTDATA_URL': 'http://127.0.0.1:24000'        
    }

[herol-gl]

Thanks for the reply. What plan should I subscribe on BrightData and what credentials should I put to the Scrapy settings or spider file?

[tubndgit]

You can use Data Center plan for scraping, you must install proxy manager on your machine, check it here https://github.com/luminati-io/luminati-proxy

[herol-gl]

I found the way to do it without installing proxy manager. Just pass the proxy url to request using meta.

yield scrapy.Request(
    url,
    headers,
    callback=self.parse,
    meta={'proxy': 'http://zone_username:zone_password@zproxy.lum-superproxy.io:22225'}
)

[tubndgit]

Yes, this is for simple usage

[philippkeller]

@herol-gl where do I find the zone_username?