FreshRSS / FreshRSS

A free, self-hostable news aggregator…
https://freshrss.org
GNU Affero General Public License v3.0
9.37k stars 809 forks source link

[Bug] Redirects not being followed in 'Type of feed source' #6703

Closed jstride closed 3 weeks ago

jstride commented 1 month ago

Describe the bug

The Google News RSS feed (http://news.google.com/rss?hl=en-AU&gl=AU&ceid=AU:en) will redirect to the source website when opened in a browser, however adding a selector, removing the limit on redirects and setting a user agent all seem to fail to fetch the full content:

image

This fetches just the RSS:

image

Even though the link loads the full source:

image

To Reproduce

Add a feed with the following RSS (http://news.google.com/rss?hl=en-AU&gl=AU&ceid=AU:en) source and selectors:

image

Expected behavior

This fetches just the RSS truncated text:

image

Expected behaviour - load the full text in FreshRss from the link loads the full source:

image

FreshRSS version

1.24.1

Environment information

Running in Docker:

Your PHP version (8.2.18) is compatible with FreshRSS.

You have the cURL library.

You have PDO and at least one of the supported drivers (pdo_mysql, pdo_sqlite, pdo_pgsql).

You have the required library for regular expressions (PCRE).

You have the required library for character type checking (ctype).

You have the fileinfo library.

You have the required library to browse the DOM.

You have the JSON extension.

You have the recommended mbstring library for Unicode.

You have the ZIP extension.

File installation Permissions on the data directory are good.

Permissions on the cache directory are good.

Permissions on the users directory are good.

Permissions on the favicons directory are good.

Permissions on the tokens directory are good.

Additional context

No response

Alkarex commented 1 month ago

At a quick glance, the redirection goes through a page, which requires JavaScript (which FreshRSS does not support natively). Try for instance the first link in a Web browser with JavaScript disabled: it leads to a blank page. That would require a FreshRSS extension or another piece of software to deal with it

jstride commented 1 month ago

Ah JavaScript, yes you're right. I'll see if I can find something in extensions. Thanks.

jstride commented 3 weeks ago

I can confirm this is a javascript issue