issues
search
monperrus
/
crawler-user-agents
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star:
MIT License
1.13k
stars
242
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update crawler-user-agents.json
#309
monperrus
closed
1 year ago
0
Add Dynatrace / RuxitSynthetic into the list
#308
matej-c
closed
1 year ago
0
Consider add Google-Read-Aloud to the bot list
#307
ictran
closed
1 year ago
1
Add Line chat crawler.
#306
aduros
closed
1 year ago
2
Added Better Uptime Bot
#305
noctivityinc
closed
1 year ago
1
Added CriteoBot
#304
noctivityinc
closed
1 year ago
2
Added Snap URL Preview Service
#303
noctivityinc
closed
1 year ago
0
Fix bingbot sermrush
#302
synhershko
closed
1 year ago
0
Add Feedbin
#301
synhershko
closed
1 year ago
0
Add curebot
#300
synhershko
closed
1 year ago
1
doc: fix php usage example
#299
Gavrisimo
closed
1 year ago
1
Add `SeekportBot`
#298
IceQ1337
closed
1 year ago
1
Add `FreshpingBot`
#297
IceQ1337
closed
1 year ago
1
Add `Uptime-Kuma`
#296
IceQ1337
closed
1 year ago
3
Add seostar
#295
theduke
closed
1 year ago
0
Add IonCrawl
#294
theduke
closed
1 year ago
0
Adding new version of existing bot entry
#293
jbuote
closed
1 year ago
1
Added trovitBot
#292
abushyk
closed
1 year ago
1
Add Freshping bot
#291
KaliszAd
closed
1 year ago
1
add cookiebot
#290
stanmertens
closed
2 years ago
2
Add cookiebot
#289
stanmertens
closed
2 years ago
2
Addition suggestion
#288
stanmertens
closed
2 years ago
4
Add minicrawler
#287
OzzyCzech
closed
2 years ago
1
Add instance for AhrefsBot
#286
frmichel
closed
2 years ago
1
Add webpagetest.org (PTST)
#285
JBYoshi
closed
2 years ago
1
add virustotal
#284
monperrus
closed
2 years ago
0
add typescript support
#283
chuv
closed
2 years ago
1
fix: relax contract
#282
monperrus
closed
2 years ago
0
Feature request virustotal
#281
akuankkan
closed
2 years ago
2
added pingdom user agents
#280
peterrydetorp
closed
2 years ago
1
Add Pingdom bots
#279
peterrydetorp
closed
2 years ago
1
Add evc-batch and PetalBot.
#278
JBYoshi
closed
3 years ago
1
Automatic npm continuous deployments broken
#277
JBYoshi
closed
3 years ago
1
Add e.ventures Investment Crawler
#276
JBYoshi
closed
3 years ago
1
Add Viber
#275
AlexanderVagner
closed
3 years ago
1
Update crawler-user-agents.json
#274
sokai
closed
2 years ago
3
added wordpress pingback
#273
nikelone
closed
3 years ago
1
Add Google-Certificates-Bridge.
#272
JBYoshi
closed
3 years ago
1
Add async Python HTTP Clients
#271
mr-linch
closed
3 years ago
1
Add PHP-Curl-Class
#270
dslh
closed
3 years ago
2
Add missing users agents of Yandex bots
#269
AlexanderVagner
closed
3 years ago
3
doc: fix link to the isbot repo
#268
omrilotan
closed
3 years ago
1
Update crawler-user-agents.json
#267
albertos77
closed
3 years ago
0
Add centurybot9
#266
thatcher
closed
2 years ago
1
add a script to generate robots.txt
#265
monperrus
opened
4 years ago
0
Add more users agents of bots found in the wild
#264
komapa
closed
4 years ago
4
add tweetedtimes
#263
fprojetto
closed
4 years ago
1
add TrendsmapResolver
#262
fprojetto
closed
4 years ago
1
Added Google+ crawler
#261
sylling
closed
3 years ago
4
Raw list of user-agents
#260
mirabellette
closed
2 years ago
1
Previous
Next