issues
search
google
/
robotstxt
The repository contains Google's robots.txt parser and matcher as a C++ library (compliant to C++11).
Apache License 2.0
3.39k
stars
230
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Teapot
#72
laertid
closed
1 month ago
1
Add an option to skip dependency installation for CMake
#71
alexeibs
opened
1 month ago
0
Support FetchContent installs
#70
rockwood-openai
opened
5 months ago
1
Docker image for robots
#69
peaceiris
closed
5 months ago
1
Create git tag for the first release
#68
peaceiris
opened
5 months ago
1
Installation for robots using Homebrew (brew)
#67
peaceiris
closed
5 months ago
2
An encoding test does not appear to match the RFC?
#64
davepeck
opened
8 months ago
0
SEOサイト
#61
oozekimarie
closed
5 months ago
0
gpyrobotstxt, a Python Native port of this repo
#60
CoconSe
opened
11 months ago
1
Pythoncallingexecutable
#59
willcritchlow
closed
1 year ago
1
Issues with Bazel build
#58
willcritchlow
opened
1 year ago
2
Special characters * and $ not matched in URI
#57
sebastian-nagel
opened
1 year ago
0
User-agent names in test ID_UserAgentValueCaseInsensitive to follow the standard
#56
sebastian-nagel
closed
2 years ago
5
Update README build requirements
#55
Gianlo98
closed
2 years ago
1
CMAKE_CXX_STANDARD 14
#54
dbugger29
closed
2 years ago
1
add bazel-skylib to workspace
#53
lucasassisrosa
closed
2 years ago
3
bazel test failed with `bazelisk`: Repository '@bazel_skylib' is not defined
#52
lucasassisrosa
closed
2 years ago
0
Combination of Crawl-delay and badbot Disallow results in blocking of Googlebot
#51
mojmirdurik
opened
2 years ago
3
googletest changed from master to main as their
#50
fabiomcosta
closed
2 years ago
3
Allow wider range of chars for valid user-agent identifier / 'product' token
#46
jimsmart
closed
2 years ago
13
Google's robots.txt parser and matchet
#45
cephasoo
closed
2 years ago
0
googletest.git has tag main
#44
dbugger29
closed
2 years ago
2
Update README to clarify scope of this library
#43
dwsmart
closed
3 years ago
5
Consider a WASM build
#42
danbri
opened
3 years ago
2
[redacted]
#41
alfodei22
closed
3 years ago
1
[redacted]
#40
alfodei22
closed
3 years ago
0
[redacted]
#39
alfodei22
closed
3 years ago
0
[redacted]
#38
alfodei22
closed
3 years ago
0
[redacted]
#37
alfodei22
closed
3 years ago
0
[redacted]
#36
alfodei22
closed
3 years ago
0
<redacted>
#35
Al-Foudai22
closed
3 years ago
2
CMAKE Build failing after newest commit to abseil/abseil-cpp
#34
zuku1985
closed
3 years ago
6
Crawl-Delay support?
#33
fluffy-critter
closed
3 years ago
1
CMAKE compilation not working on Ubuntu 16.04
#32
juliend2
opened
4 years ago
0
A rust ported robotstxt
#31
Folyd
opened
4 years ago
0
Library ported to Go
#29
jimsmart
opened
4 years ago
2
Fix some clang-tidy and PVS Studio warnings
#28
Folyd
opened
4 years ago
3
I think this comment is misleading
#27
willcritchlow
opened
4 years ago
1
Modify to allow comma-separated list of user agents
#26
willcritchlow
opened
5 years ago
4
Removes an unnecessary variable.
#25
anubhavp28
closed
5 years ago
3
fix typo: the target name is test
#24
lvandeve
closed
5 years ago
0
duplicate function body
#23
raingart
closed
1 year ago
2
Should REP define the `X-Robots-Tag` header?
#22
Malvoz
closed
5 years ago
1
Fixed typo in comment
#21
sheetalsingala
closed
5 years ago
3
[fix] correct function comment
#20
happyxgang
closed
5 years ago
2
Fix minor typos
#19
luchaninov
closed
5 years ago
3
typos
#18
luchaninov
closed
5 years ago
2
typos
#17
luchaninov
closed
5 years ago
4
Update README.md
#16
alanyee
closed
5 years ago
0
Early return
#15
Korilakkuma
closed
5 years ago
0
Next