FreshRSS / FreshRSS

A free, self-hostable news aggregator…
https://freshrss.org
GNU Affero General Public License v3.0
9.84k stars 844 forks source link

[Bug] Error when adding feed https://www.ghacks.net/feed #5177

Open conchra opened 1 year ago

conchra commented 1 year ago

Describe the Bug

Server log:

 cURL error 22: The requested URL returned error: 403 [https://www.ghacks.net/feed.rss]

cURL:

curl -v "https://www.ghacks.net/feed"
*   Trying [2606:4700:20::681a:1fa]:443...
* Connected to www.ghacks.net (2606:4700:20::681a:1fa) port 443 (#0)
* ALPN: offers h2,http/1.1
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
*  CAfile: C:/Data/__Apps/REn/App/Rbase42/etc/curl-ca-bundle.crt
*  CApath: none
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.3 (IN), TLS handshake, Encrypted Extensions (8):
* TLSv1.3 (IN), TLS handshake, Certificate (11):
* TLSv1.3 (IN), TLS handshake, CERT verify (15):
* TLSv1.3 (IN), TLS handshake, Finished (20):
* TLSv1.3 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.3 (OUT), TLS handshake, Finished (20):
* SSL connection using TLSv1.3 / TLS_AES_256_GCM_SHA384
* ALPN: server accepted h2
* Server certificate:
*  subject: C=US; ST=California; L=San Francisco; O=Cloudflare, Inc.; CN=ghacks.net
*  start date: Oct 19 00:00:00 2022 GMT
*  expire date: Oct 18 23:59:59 2023 GMT
*  subjectAltName: host "www.ghacks.net" matched cert's "*.ghacks.net"
*  issuer: C=US; O=Cloudflare, Inc.; CN=Cloudflare Inc ECC CA-3
*  SSL certificate verify ok.
* using HTTP/2
* h2h3 [:method: GET]
* h2h3 [:path: /feed]
* h2h3 [:scheme: https]
* h2h3 [:authority: www.ghacks.net]
* h2h3 [user-agent: curl/7.88.1]
* h2h3 [accept: */*]
* Using Stream ID: 1 (easy handle 0xa00034990)
> GET /feed HTTP/2
> Host: www.ghacks.net
> user-agent: curl/7.88.1
> accept: */*
>
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* TLSv1.3 (IN), TLS handshake, Newsession Ticket (4):
* old SSL session ID is stale, removing
< HTTP/2 403
< date: Tue, 07 Mar 2023 10:02:27 GMT
< content-type: text/html; charset=UTF-8
< permissions-policy: accelerometer=(),autoplay=(),camera=(),clipboard-read=(),clipboard-write=(),fullscreen=(),geolocation=(),gyroscope=(),hid=(),interest-cohort=(),magnetometer=(),microphone=(),payment=(),publickey-credentials-get=(),screen-wake-lock=(),serial=(),sync-xhr=(),usb=()
< referrer-policy: same-origin
< x-frame-options: SAMEORIGIN
< cache-control: private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0
< expires: Thu, 01 Jan 1970 00:00:01 GMT
< report-to: {"endpoints":[{"url":"https:\/\/a.nel.cloudflare.com\/report\/v3?s=g1TMvcdVm2z5agPaLhv2r%2BM%2Blo97so24pZJtFFL0vC2ZUkJubPcaw0SkbSiLAFJ7tih2ce6AablKJHFL582yUsrWz6ifWaoTxcvTUQetTbLl%2BLZjiJgNysnBgs2fHXg1DTp%2FmjSw8ZOkVqaO"}],"group":"cf-nel","max_age":604800}
< nel: {"success_fraction":0,"report_to":"cf-nel","max_age":604800}
< server: cloudflare
< cf-ray: 7a4200c3cf4d32a4-BNE
<
<!DOCTYPE html>
....html removed for brevity....
</html>
* Connection #0 to host www.ghacks.net left intact

To Reproduce

Expected behaviour

Environment information (please complete the following information)

Frenzie commented 1 year ago

Add the feed https://www.ghacks.net/feed

There's no such thing (though the 403 comes from CloudFlare idiocy, the 404 is post-CloudFlare).

image

Frenzie commented 1 year ago

Hm, why is your error message giving the different URL of cURL error 22: The requested URL returned error: 403 [https://www.ghacks.net/feed.rss].

But yeah, same issue as https://github.com/FreshRSS/FreshRSS/issues/5086#issuecomment-1423296428

metbril commented 1 year ago

It looks like the /feed/ url is just a redirect to a random feed path. I think they are doing this to track us. If I open the /feed/ url in Firefox, a file with an 8 character random filename is downloaded.