r-lib / urlchecker

Run CRAN URL checks from older versions of R
https://urlchecker.r-lib.org/
GNU General Public License v3.0
47 stars 5 forks source link

Why can't we see this in urlchecker #26

Open gaborcsardi opened 2 years ago

gaborcsardi commented 2 years ago
❯ options("HTTPUserAgent" = "R (4.2.1 aarch64-apple-darwin20 aarch64 darwin20)")
❯ download.file("https://support.rstudio.com/hc/en-us/articles/206382178-Customizing-Keyboard-Shortcuts", tempfile())
trying URL 'https://support.rstudio.com/hc/en-us/articles/206382178-Customizing-Keyboard-Shortcuts'
Error in download.file("https://support.rstudio.com/hc/en-us/articles/206382178-Customizing-Keyboard-Shortcuts",  :
  cannot open URL 'https://support.rstudio.com/hc/en-us/articles/206382178-Customizing-Keyboard-Shortcuts'
In addition: Warning message:
In download.file("https://support.rstudio.com/hc/en-us/articles/206382178-Customizing-Keyboard-Shortcuts",  :
  cannot open URL 'https://support.rstudio.com/hc/en-us/articles/206382178-Customizing-Keyboard-Shortcuts': HTTP status was '403 Forbidden'
❯ curlGetHeaders("https://support.rstudio.com/hc/en-us/articles/206382178-Customizing-Keyboard-Shortcuts")
 [1] "HTTP/2 403 \r\n"

[...]

This is with the default user agent header, which R "helpfully" replaces with libcurl/....

hadley commented 2 years ago

Alternatively should we try and get CRAN to change the UA they use for these checks?