scrapy / protego

A pure-Python robots.txt parser with support for modern conventions.
BSD 3-Clause "New" or "Revised" License
54 stars 28 forks source link

Only prefix absolute URLs with / #34

Closed Gallaecio closed 1 year ago

Gallaecio commented 1 year ago

Alternative approach to #8 that passes the introduced test for #4 without causing the issue that lead to #24.

Closes #24.

codecov[bot] commented 1 year ago

Codecov Report

Merging #34 (556b810) into master (6c7c318) will increase coverage by 0.59%. The diff coverage is 100.00%.

:exclamation: Current head 556b810 differs from pull request most recent head 17dd86b. Consider uploading reports for the commit 17dd86b to get more accurate results

@@            Coverage Diff             @@
##           master      #34      +/-   ##
==========================================
+ Coverage   97.87%   98.47%   +0.59%     
==========================================
  Files           1        1              
  Lines         330      327       -3     
  Branches       83       83              
==========================================
- Hits          323      322       -1     
+ Misses          4        3       -1     
+ Partials        3        2       -1     
Files Changed Coverage Δ
src/protego.py 98.47% <100.00%> (+0.59%) :arrow_up: