alecxe scrapy-fake-useragent issues

alecxe / scrapy-fake-useragent

Random User-Agent middleware based on fake-useragent

MIT License

686 stars 98 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Is there a way to filter the obtained user-agents?

#43 FcoDonDev opened 5 months ago
0
Add support for `RETRY_EXCEPTIONS` setting

#42 Prometheus3375 opened 1 year ago
1
Add support for Scrapy 2.10 and `RETRY_EXCEPTIONS` setting

#41 Prometheus3375 opened 1 year ago
0
Update providers.py

#40 jansonh closed 1 year ago
0
Can't download urls

#39 CarterT27 closed 1 year ago
1
Heroku Application Broken

#38 james-innes closed 1 year ago
2
Update requirements.txt

#37 alvarochvz closed 2 years ago
0
FakerProvider not working

#36 axiangcoding opened 2 years ago
3
Will this middleware work with the scrapy-splash middleware?

#34 lucaguarro opened 3 years ago
2
cant scrapy-fake-useragent work well with pymongo??

#33 doi-h closed 3 years ago
1
User timeout caused connection failure - Only on specific sites as soon as download middlewares are specified

#32 mmotti opened 3 years ago
0
FAKE_USERAGENT_RANDOM_UA_TYPE = 'desktop' >>> KeyError: 'desktop'

#31 codekoriko closed 4 years ago
7
FakerProvider not working ?

#30 SecT0uch closed 4 years ago
5
Middleware completely preventing scraper from starting/crawling

#29 caffeinatedMike closed 4 years ago
3
Support for different UA providers

#28 0xfede7c8 closed 4 years ago
11
[CRITICAL] useragentstring.com not working anymore

#27 0xfede7c8 closed 4 years ago
12
User Agent not updating

#26 yilu1015 closed 4 years ago
2
Update middleware.py

#25 vionemc closed 4 years ago
2
Add RetryUserAgentMiddleware

#24 vionemc closed 4 years ago
0
docs clarification

#23 Ostapp opened 5 years ago
4
Fallback causing it always use Fallback user agent even though there is no error

#22 vionemc closed 5 years ago
1
User agent pool website is down

#21 alecsci closed 5 years ago
1
Usage of setdefault and retries

#20 lee-hodg closed 4 years ago
9
useragentstring.com down, how to change other source ?

#19 ttpro1995 closed 7 years ago
1
middleware.py: Add FAKEUSERAGENT_FALLBACK configuration

#18 refeed closed 7 years ago
0
Syntax highlighting

#17 brunomperes closed 7 years ago
0
Added info for installation & syntax highlighting

#16 brunomperes closed 7 years ago
2
How to add to project?

#15 brunomperes closed 7 years ago
2
Enabling FALLBACK setting on `settings.py`

#14 vionemc closed 7 years ago
1
SSL Certificate expired

#13 Slater-Victoroff closed 7 years ago
1
Custom folder for local Cache DB

#12 bezkos opened 7 years ago
1
Picking different proxy types.

#11 medse closed 7 years ago
7
Random browser user agents or random user agents?

#10 japborst closed 7 years ago
2
scrapy-fake-useragent and cfscrape cloudfare anti bot library

#9 reyman closed 7 years ago
4
Merge scrapy-fake-useragent into fake-useragent

#8 hellysmile closed 4 years ago
7
http://useragentstring.com/ is DOWN

#7 carvajalluis closed 7 years ago
12
Restrict User-Agent to Desktop Devices

#6 vaulstein closed 4 years ago
12
Allow assign different UA to each different proxy,

#5 ThunderEX closed 8 years ago
1
the library doesn't work anymore

#4 mayouf closed 8 years ago
4
Deprecated class warning on disabling UserAgentMiddleware

#3 shafaq closed 8 years ago
1
Didn't work when used to scrape linkedin

#2 vionemc closed 8 years ago
3
Hosting on pypi

#1 Roconda closed 9 years ago
1