search

qbittorrent / qBittorrent

qBittorrent BitTorrent client
https://www.qbittorrent.org
Other
28.5k stars 4k forks source link

RSS Feed Only Refreshes after Restart #10215

Closed jhlee2222 closed 5 years ago

jhlee2222 commented 5 years ago

Please provide the following information

qBittorrent version and Operating System

4.1.5, Windows 10

If on linux, libtorrent and Qt version

(type here)

What is the problem

RSS feeds configured for monitoring and auto-downloading do not refresh on their own or manually, even though changes to the RSS feed are visible. After closing qBittorrent and reopening it, feeds immediately refresh and any new articles in the feeds start downloading.

What is the expected behavior

qBittorrent should refresh and fetch RSS feeds on the set interval or should refresh them manually when clicking "Update all".

Steps to reproduce

Install qBittorrent, add an RSS feed, set the refresh interval.

Extra info(if any)

This is a completely new installation. I am using a feed of published articles from a personal Tiny Tiny RSS installation. I would rather not publicly post the feed URL here. The problem does not seem to be with the feed, since the feed is viewable and reflects updates when viewed via a browser. qBittorrent also recognizes the feed as valid, reflects changes to it, and downloads from it, but sadly only after a complete closure and restart of qBittorrent.

glassez commented 5 years ago

I would rather not publicly post the feed URL here.

You could at least post an appropriate log messages. The value is the period during which your RSS feed has to be updated several times. Also you can post a couple of feed snapshots (source XML that you can obtain using your browser). You can obfuscate all private data from it but keep its structure.

jhlee2222 commented 5 years ago

I'm not sure I understand how to find the log message you refer to. Here are screens of the RSS details and settings though: 2019-01-26 11_02_50-yurd 2019-01-26 11_02_34-yurd

Here is the XML of the feed, with my URL altered to hide the IP:

<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet type="text/xsl" href="atom-to-html.xsl"?>

<feed xmlns="http://www.w3.org/2005/Atom">
<title>Published articles</title>
<generator uri="http://tt-rss.org/">Tiny Tiny RSS/16.1 (94d425f)</generator>
<updated>2019-01-11T02:30:55+00:00</updated>
<id>http://111.111.111.111/public.php?op=rss&amp;id=-2&amp;key=eqeftx5c366922f34fe</id>
<link href="http://111.111.111.111/public.php?op=rss&amp;id=-2&amp;key=eqeftx5c366922f34fe" rel="self"/>

<link href="http://111.111.111.111" rel="alternate"/>

<entry>
    <id>tag:111.111.111.111,2019-01-26:/976487</id>
    <link href="magnet:?xt=urn:btih:DTIP5OVLMRSGPE3VVBSOEVF5OSYUKMF2&amp;tr=http://nyaa.tracker.wf:7777/announce&amp;tr=udp://tracker.coppersurfer.tk:6969/announce&amp;tr=udp://tracker.internetwarriors.net:1337/announce&amp;tr=udp://tracker.leechersparadise.org:6969/announce&amp;tr=udp://tracker.opentrackr.org:1337/announce&amp;tr=udp://open.stealth.si:80/announce&amp;tr=udp://p4p.arenabg.com:1337/announce&amp;tr=udp://mgtracker.org:6969/announce&amp;tr=udp://tracker.tiny-vps.com:6969/announce&amp;tr=udp://peerfect.org:6969/announce&amp;tr=http://share.camoe.cn:8080/announce&amp;tr=http://t.nyaatracker.com:80/announce&amp;tr=https://open.kickasstracker.com:443/announce" rel="alternate" type="text/html"/>
    <title type="html">[HorribleSubs] Radiant - 17 [1080p].mkv</title>
    <summary type="html"><![CDATA[]]></summary>
    <content type="html"><![CDATA[]]></content>
    <updated>2019-01-26T12:15:35+00:00</updated>
    <author><name></name></author>
    <source>
        <id>http://www.horriblesubs.info</id>
        <link rel="self" href="http://www.horriblesubs.info"/>
        <updated>2019-01-26T12:15:35+00:00</updated>
        <title>HorribleSubs RSS</title></source>

</entry>

<entry>
    <id>tag:111.111.111.111,2019-01-25:/976388</id>
    <link href="magnet:?xt=urn:btih:2EACFACEBA1967032B1443F76BBA7E63D6C58568&amp;dn=Young+Justice+S03E13+WEBRip+x264+ION10&amp;tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969%2Fannounce&amp;tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969%2Fannounce&amp;tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&amp;tr=http%3A%2F%2Ftracker.trackerfix.com%3A80%2Fannounce" rel="alternate" type="text/html"/>
    <title type="html">Young Justice S03E13 WEBRip x264 ION10</title>
    <summary type="html"><![CDATA[New episode: Young Justice S03E13 WEBRip x264 ION10]]></summary>
    <content type="html"><![CDATA[<html><body><p>New episode: Young Justice S03E13 WEBRip x264 ION10</p></body></html>
]]></content>
    <updated>2019-01-25T18:55:20+00:00</updated>
    <author><name></name></author>
    <source>
        <id>http://showrss.info</id>
        <link rel="self" href="http://showrss.info"/>
        <updated>2019-01-25T18:55:20+00:00</updated>
        <title>showRSS personal feed</title></source>
glassez commented 5 years ago

I'm not sure I understand how to find the log message you refer to.

You can enable it with View -> Log menu.

jhlee2222 commented 5 years ago

OK, I found the log. Here's an example of the feed after I publish three more entries to it:

<?xml version="1.0" encoding="utf-8"?>
<?xml-stylesheet type="text/xsl" href="atom-to-html.xsl"?>

<feed xmlns="http://www.w3.org/2005/Atom">
<title>Published articles</title>
<generator uri="http://tt-rss.org/">Tiny Tiny RSS/16.1 (94d425f)</generator>
<updated>2019-01-11T02:30:55+00:00</updated>
<id>http://111.111.111.111/public.php?op=rss&amp;id=-2&amp;key=eqeftx5c366922f34fe</id>
<link href="http://111.111.111.111/public.php?op=rss&amp;id=-2&amp;key=eqeftx5c366922f34fe" rel="self"/>

<link href="http://111.111.111.111" rel="alternate"/>

<entry>
    <id>tag:111.111.111.111,2019-01-27:/976685</id>
    <link href="magnet:?xt=urn:btih:X5IATPA2L4JVEYFO7ZXOZPC2EMH43OCS&amp;tr=http://nyaa.tracker.wf:7777/announce&amp;tr=udp://tracker.coppersurfer.tk:6969/announce&amp;tr=udp://tracker.internetwarriors.net:1337/announce&amp;tr=udp://tracker.leechersparadise.org:6969/announce&amp;tr=udp://tracker.opentrackr.org:1337/announce&amp;tr=udp://open.stealth.si:80/announce&amp;tr=udp://p4p.arenabg.com:1337/announce&amp;tr=udp://mgtracker.org:6969/announce&amp;tr=udp://tracker.tiny-vps.com:6969/announce&amp;tr=udp://peerfect.org:6969/announce&amp;tr=http://share.camoe.cn:8080/announce&amp;tr=http://t.nyaatracker.com:80/announce&amp;tr=https://open.kickasstracker.com:443/announce" rel="alternate" type="text/html"/>
    <title type="html">[HorribleSubs] Manaria Friends - 02 [480p].mkv</title>
    <summary type="html"><![CDATA[]]></summary>
    <content type="html"><![CDATA[]]></content>
    <updated>2019-01-27T17:05:29+00:00</updated>
    <author><name></name></author>
    <source>
        <id>http://www.horriblesubs.info</id>
        <link rel="self" href="http://www.horriblesubs.info"/>
        <updated>2019-01-27T17:05:29+00:00</updated>
        <title>HorribleSubs RSS</title></source>

</entry>

<entry>
    <id>tag:111.111.111.111,2019-01-27:/976684</id>
    <link href="magnet:?xt=urn:btih:O7HTU3AVATSWOPQI32VPSLDABRW6G2WE&amp;tr=http://nyaa.tracker.wf:7777/announce&amp;tr=udp://tracker.coppersurfer.tk:6969/announce&amp;tr=udp://tracker.internetwarriors.net:1337/announce&amp;tr=udp://tracker.leechersparadise.org:6969/announce&amp;tr=udp://tracker.opentrackr.org:1337/announce&amp;tr=udp://open.stealth.si:80/announce&amp;tr=udp://p4p.arenabg.com:1337/announce&amp;tr=udp://mgtracker.org:6969/announce&amp;tr=udp://tracker.tiny-vps.com:6969/announce&amp;tr=udp://peerfect.org:6969/announce&amp;tr=http://share.camoe.cn:8080/announce&amp;tr=http://t.nyaatracker.com:80/announce&amp;tr=https://open.kickasstracker.com:443/announce" rel="alternate" type="text/html"/>
    <title type="html">[HorribleSubs] Manaria Friends - 02 [720p].mkv</title>
    <summary type="html"><![CDATA[]]></summary>
    <content type="html"><![CDATA[]]></content>
    <updated>2019-01-27T17:05:52+00:00</updated>
    <author><name></name></author>
    <source>
        <id>http://www.horriblesubs.info</id>
        <link rel="self" href="http://www.horriblesubs.info"/>
        <updated>2019-01-27T17:05:52+00:00</updated>
        <title>HorribleSubs RSS</title></source>

</entry>

<entry>
    <id>tag:111.111.111.111,2019-01-27:/976683</id>
    <link href="magnet:?xt=urn:btih:S5R2LU5FEFNOHI62NT2Q6ZKLFOCAOUXD&amp;tr=http://nyaa.tracker.wf:7777/announce&amp;tr=udp://tracker.coppersurfer.tk:6969/announce&amp;tr=udp://tracker.internetwarriors.net:1337/announce&amp;tr=udp://tracker.leechersparadise.org:6969/announce&amp;tr=udp://tracker.opentrackr.org:1337/announce&amp;tr=udp://open.stealth.si:80/announce&amp;tr=udp://p4p.arenabg.com:1337/announce&amp;tr=udp://mgtracker.org:6969/announce&amp;tr=udp://tracker.tiny-vps.com:6969/announce&amp;tr=udp://peerfect.org:6969/announce&amp;tr=http://share.camoe.cn:8080/announce&amp;tr=http://t.nyaatracker.com:80/announce&amp;tr=https://open.kickasstracker.com:443/announce" rel="alternate" type="text/html"/>
    <title type="html">[HorribleSubs] Manaria Friends - 02 [1080p].mkv</title>
    <summary type="html"><![CDATA[]]></summary>
    <content type="html"><![CDATA[]]></content>
    <updated>2019-01-27T17:06:38+00:00</updated>
    <author><name></name></author>
    <source>
        <id>http://www.horriblesubs.info</id>
        <link rel="self" href="http://www.horriblesubs.info"/>
        <updated>2019-01-27T17:06:38+00:00</updated>
        <title>HorribleSubs RSS</title></source>

</entry>

However, the qBittorrent log shows it's checking the feed, but finding no articles, until I restart qBittorrent. Here's the log then:

1/27/2019 1:49 PM - Successfully moved torrent: [HorribleSubs] Manaria Friends - 02 [720p].mkv. New path: C:\Files\Rename\temp\
1/27/2019 1:49 PM - Successfully moved torrent: [HorribleSubs] Manaria Friends - 02 [1080p].mkv. New path: C:\Files\Rename\temp\
1/27/2019 1:49 PM - Successfully moved torrent: [HorribleSubs] Manaria Friends - 02 [480p].mkv. New path: C:\Files\Rename\temp\
1/27/2019 1:49 PM - External IP: 46.166.191.22
1/27/2019 1:49 PM - '9763a5d3a5215ae3a3da6cf50f654b2b840752e3' added to download list.
1/27/2019 1:49 PM - '77cf3a6c1504e5673e08deaaf92c600c6de36ac4' added to download list.
1/27/2019 1:49 PM - 'bf5009bc1a5f135260aefe6eecbc5a230fcdb852' added to download list.
**1/27/2019 1:49 PM - RSS feed at 'http://111.111.111.111/public.php?op=rss&amp;id=-2&amp;key=eqeftx5c366922f34fe' updated. Added 3 new articles.**
1/27/2019 1:49 PM - UPnP/NAT-PMP: Port mapping successful, message: successfully mapped port using UPnP. external port: TCP/8080
1/27/2019 1:49 PM - UPnP/NAT-PMP: Port mapping successful, message: successfully mapped port using UPnP. external port: UDP/8999
1/27/2019 1:49 PM - UPnP/NAT-PMP: Port mapping successful, message: successfully mapped port using UPnP. external port: TCP/8999
1/27/2019 1:49 PM - External IP: 71.56.122.61
1/27/2019 1:49 PM - qBittorrent is successfully listening on interface 0.0.0.0 port: UDP/8999
1/27/2019 1:49 PM - qBittorrent is successfully listening on interface 0.0.0.0 port: TCP/8999
1/27/2019 1:49 PM - qBittorrent is successfully listening on interface :: port: TCP/8999
1/27/2019 1:49 PM - Options were saved successfully.
1/27/2019 1:49 PM - Web UI: Now listening on IP: *, port: 8080
1/27/2019 1:49 PM - Web UI translation for selected locale (en) has been successfully loaded.
1/27/2019 1:49 PM - Using built-in Web UI.
1/27/2019 1:49 PM - GeoIP database loaded. Type: GeoLite2-Country. Build time: Tue Jan 8 19:40:18 2019.
1/27/2019 1:49 PM - UPnP / NAT-PMP support [ON]
1/27/2019 1:49 PM - Embedded Tracker [OFF]
1/27/2019 1:49 PM - Encryption support [ON]
1/27/2019 1:49 PM - Anonymous mode [ON]
1/27/2019 1:49 PM - PeX support [ON]
1/27/2019 1:49 PM - Local Peer Discovery support [ON]
1/27/2019 1:49 PM - DHT support [ON]
1/27/2019 1:49 PM - HTTP User-Agent is 'qBittorrent/4.1.5'
1/27/2019 1:49 PM - Peer ID: -qB4150-
1/27/2019 1:49 PM - qBittorrent is trying to listen on any interface port: 8999
1/27/2019 1:49 PM - qBittorrent v4.1.5 started

@glassez , I'm happy to share the feed URL with you via a private message if that helps in troubleshooting this. I just don't want to make the URL public.

I appreciate your assistance on this so far.

glassez commented 5 years ago

@jhlee2222, please don't paste any xml/html (and even other text blocks) without quotation.

glassez commented 5 years ago

@jhlee2222, unfortunately, your examples of the log and the XML is useless. You still don't understand what I need. In order to assess the problem a little bit, I need at least two full snapshots of your RSS feed made during one qBittorrent session, and the corresponding log messages. Or (much more better) access to your feed for testing.

glassez commented 5 years ago

I'm happy to share the feed URL with you via a private message if that helps in troubleshooting this.

Of course. You cam email it me.

ghost commented 5 years ago

I also have this same problem. Let me know If you need any additional information.

glassez commented 5 years ago

Let me know If you need any additional information.

I need affected feed URL for testing. You can email it me unless you can publish it here.

ghost commented 5 years ago

https://nyaa.si/?page=rss&q=Tate+no+Yuusha+no+Nariagari+horriblesubs+1080&c=0_0&f=0

Gets stuck with the picture of the spinning loading sign and like @jhlee2222 says it will work if you restart the client.

glassez commented 5 years ago

@BrianDaTruth, sorry, I can't test your RSS feed, it's blocked by my ISP.

ghost commented 5 years ago

Dang, well I can post the log of when it happens. However, I just restarted the client so it probably won't happen for a bit.

ghost commented 5 years ago

The logs actually don't say anything. When the feed is stuck if I click update all button manually nothing new appears in the logs. Is there more detail logs somewhere that I'm not aware of?

glassez commented 5 years ago

As of @jhlee2222 issue... qBittorrent performs full parsing of RSS feed data received for the first time during the session. In subsequent times, it applies optimization using "lastBuildDate" entry ("updated" in case of Atom feed). If "lastBuildDate" hasn't changed since last time, qBittorrent skip parsing and doesn't update the feed. Your feed doesn't update this entry so qBittorrent considered it as unchanged.

Maybe we need adding a log message in case of optimization is applied.

glassez commented 5 years ago

Gets stuck with the picture of the spinning loading sign

It is another issue. Seems like network-related error. I can't test/fix it without reproducing it. @BrianDaTruth, are you sure your feed is accessible at that time? Are you able to view it in browser?

ghost commented 5 years ago

Yeah, I have the spinning signs right now but I can access it in a web browser and manual refresh doesn't work. @glassez I also know if I restart the client it will fix the spinning icons and start downloading the missing episodes.

architdate commented 5 years ago

Have the exact same issue. Feel free to let me know if any help is needed in regards to this. If a specific qBittorrent version fixes this issue, I would love to know as well!

glassez commented 5 years ago

Have the exact same issue.

Do you mean "the spinning signs" issue?

Feel free to let me know if any help is needed in regards to this.

Nothing beyond what I asked other reporters to do. I need access to the affected feed for testing (i.e. I need its URL).

architdate commented 5 years ago

Yeah, it does not auto refresh nyaa RSS feeds and is constantly stuck on the spinning circle. Restart of the client fixes the issue. The issue seems to happen for all nyaa RSS based feeds. (Does not seem to affect showRSS). Will attach an exported json so you can have all the RSS related info you need.

architdate commented 5 years ago

rules.zip The file contains rules.json of the RSS downloader rules. Also one thing to mention is that this does not happen immediately on the first refresh interval. However after being idle for a while (have not determined how long it takes yet) we have the spinning circle issue. All of the feeds that don't begin with showRSS seem to be affected

jgmachine commented 5 years ago

I also periodically have this problem. I'm pulling from the eztv rss feed. I'll check the feed and it has a stuck loading circle. If I close out qbittorrent, I cannot get it to re-open without restarting my computer.

I have mine set to refresh every 30 minutes with the max number of articles per feed set to 200.

If there's anything I can do to help further troubleshoot this problem, I'm happy to help.

architdate commented 5 years ago

Tried to roll back to 4.1.4.. still have the same issue. Will try to check which version initially had this issue

architdate commented 5 years ago

@glassez any progress regarding the issue? Let me know if you need any more info from me. I have noticed a common theme of HorribleSubs torrents failing the RSS refresh (also eztv for @jgmachine ) but for everyone else who has messaged in this issue thread, its been a horriblesubs based Nyaa RSS it seems

Lorgra93 commented 5 years ago

Same problem here, I also only have nyaa feeds.

architdate commented 5 years ago

I added a script to Windows Task Scheduler to restart qBittorrent every hour to solve this issue kinda. A quick fix for people who have this issue. Definitely not a permafix, but works till the devs commit an official fix

robotman321 commented 5 years ago

Thanks @architdate, it's hokey but the best option those of us with the issue have for now. I was going about 6 days before it stopped loading rss feeds for me.

If I can add any details to help facilitate a fix, let me know.

glassez commented 5 years ago

Unfortunately, a simple code inspection does not bring any results with this problem. And I can't think of a more reliable way to indicate this process. Currently it changes the status icon at the beginning of the update (i.e. when it schedules a request to the server). Then it changes the icon again when the response from the server is received and parsed (or something failed). Also a log message is added at the end of the update. One more intermediate message is printed in debug output when the request is received/failed and qBittorrent starts to parse it. Should this message be added in the log instead?

mehti1367 commented 5 years ago

Same here.

tongyifan commented 5 years ago

Same problem.

ghost commented 5 years ago

Updated to 4.1.6, same issue. RSS works for about 12 hours after a restart then stops. No error in the logs. All the RSS feeds' icons look like spinners (like it was trying to update and froze). This was working fine in 3.x - whatever enhancements were made have introduced a bug. Hope you can fix this.

EDIT: For me - has to do with the SOCKS5 proxy - RSS stops working after 12 hours. Disabling RSS through the proxy and then re-enabling it resolves the problem for me.

glassez commented 5 years ago

Can someone test #10723? It closes a similar issue for me.