Qolors / FeedCord

A dead simple RSS Feed with Discord Webhooks
MIT License
127 stars 5 forks source link

Bypass feed errors ? #27

Closed KatyPurry closed 4 months ago

KatyPurry commented 5 months ago

Hello,

Thank you for your amazing project ! I have an error with a feed : https://www.mamytwink.com/feed.xml, it returns an error : W: An unexpected error occurred while parsing the RSS feed

I've tested it with other solutions (like FreshRSS) and it seems to pass, is there anything I can do to get Feedcord to work with it?

thank you !

xavier-hernandez commented 4 months ago

@KatyPurry This seems to work for me. No errors. Maybe try again.

KatyPurry commented 4 months ago

Hello, Tried with this feed only, still have the error :

I: Creating new RssCheckerBackgroundService instance for WoW Chanel
I: WoW Chanel Created with check interval 3 minutes
I: WoW Chanel Starting Background Processing at 04/24/2024 14:24:15..
I: WoW Chanel: Initializing Url Checks..
I: Successfully initialized URL: https://www.mamytwink.com/feed.xml
I: No URLs in Youtube feed, skipping...
I: WoW Chanel: Tested successfully for 1 out of 1 Urls in Configuration File
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
W: An unexpected error occurred while parsing the RSS feed
W: Failed to fetch or process the RSS feed from https://www.mamytwink.com/feed.xml.. Error Count: 1
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/24/2024 14:24:15..
{
    "Instances": [
        {
            "Id": "WoW Chanel",
            "Username": "World of Warcraft",
            "RssUrls": [
                "https://www.mamytwink.com/feed.xml"

            ],
            "YoutubeUrls": [ "" ],
            "DiscordWebhookUrl": "https://discord.com/api/webhooks/1225884505336975360/***",
            "RssCheckIntervalMinutes": 3,
            "EnableAutoRemove": true,
            "Color": 16760576,
            "DescriptionLimit": 200,
            "Forum": false
        }
    ]
}
xavier-hernandez commented 4 months ago

I figured out the issue. The feed is zipped and needs to be decompressed. I'm not the author of this repo, but I started using it recently. I've opened a PR.

Maybe if they don't respond in a couple of days, I'll update and create my own docker image, but I'd rather not.

Qolors commented 4 months ago

@KatyPurry please pull the latest image v2.1.1 - cheers!

KatyPurry commented 4 months ago

Thank you for the PR ! After testing, no more error but FeedCord doesn't seem to find the new entries. An article was posted 2 hours ago, it appears in the XML file, but FeedCord doesn't see it.

xavier-hernandez commented 4 months ago

New version is working for me. You can check your logs.

something like : docker container logs FeedCord

KatyPurry commented 4 months ago

Yes, no error in logs, just no new entries found. I'll try to wait a day to be sure.

I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 21:54:02..
I: WoW Chanel Starting Background Processing at 04/25/2024 21:57:02..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 21:57:15..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:00:15..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:00:29..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:03:29..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:03:43..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:06:43..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:06:58..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:09:58..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:10:12..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:13:12..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:13:26..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:16:26..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:16:40..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:19:40..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:19:54..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:22:54..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:23:07..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:26:07..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:26:21..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:29:21..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:29:35..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:32:35..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:32:48..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:35:48..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:36:02..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:39:02..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:39:15..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:42:15..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:42:29..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:45:29..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:45:43..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:48:43..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:48:57..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:51:57..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:52:11..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:55:11..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:55:25..
I: WoW Chanel Starting Background Processing at 04/25/2024 22:58:25..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 22:58:38..
I: WoW Chanel Starting Background Processing at 04/25/2024 23:01:38..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 23:01:52..
I: WoW Chanel Starting Background Processing at 04/25/2024 23:04:52..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 23:05:06..
xavier-hernandez commented 4 months ago

According to the feed the last post was at 19:26:56 today.

Qolors commented 4 months ago

@KatyPurry I'm going to run this feed with a test build that's more verbose in it's logging tonight and see if I can replicate the issue. Hang tight 👍

KatyPurry commented 4 months ago

According to the feed the last post was at 19:26:56 today.

Yeah you right, checked logs around this time, no new posts found :


I: WoW Chanel Starting Background Processing at 04/25/2024 19:24:50..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 19:25:04..
I: WoW Chanel Starting Background Processing at 04/25/2024 19:28:04..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 19:28:18..
I: WoW Chanel Starting Background Processing at 04/25/2024 19:31:18..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 19:31:32..
I: WoW Chanel Starting Background Processing at 04/25/2024 19:34:32..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 19:34:46..
I: WoW Chanel Starting Background Processing at 04/25/2024 19:37:46..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..
I: WoW Chanel Finished Background Processing at 04/25/2024 19:38:01..
I: WoW Chanel Starting Background Processing at 04/25/2024 19:41:01..
I: Checking if any new posts for https://www.mamytwink.com/feed.xml...
I: WoW Chanel: Found no new posts. Ending background process..

@KatyPurry I'm going to run this feed with a test build that's more verbose in it's logging tonight and see if I can replicate the issue. Hang tight 👍

Thank you !

Qolors commented 4 months ago

Hey @KatyPurry sorry for the delayed response! Any luck on your end?

I went ahead and used the latest build but altered one thing which was overriding the start up date that FeedCord compares the posts to.

Overriding my date to be set for 04/25/2024 19:25:00 - it successfully managed to pick up 7 new posts that are newer than that date and post them just fine.. So I am unable to replicate your issue..

Have you tried deleting the container & image then re-pulling the latest image? If you would like to, I can upload a development build that print the dates and some more information in the logs.

KatyPurry commented 4 months ago

Thank you for your reply ! I can also confirm that everything works. I didn't quite understand why it couldn't find the first 2 items. I don't think it's ever a bad idea to add information to the logs, as it's sure to solve problems in the future :D

Qolors commented 4 months ago

Great to hear it's working for you now! Yep I do agree logging isn't where I'd like it.. I hope to add a VerboseLogging option in the config for things like this.