[fetcher] Rome doesn't seem to parse the pubDate correctly out of the RSS feed when it is CDATA

mishako commented 8 years ago

Issue by PatrickGotthard Monday Sep 30, 2013 at 15:37 GMT Originally opened as https://github.com/rometools/rome-fetcher/issues/2

=== This issue was migrated from JIRA ===
Type: Bug
Priority: Minor
Status: Open
Resolution: Unresolved
Environment: Java 6/Linux/ Rome and Rome fetcher 1.0.
Reported by: Jeffrey Haskovec
Assigned to: Nick Lothian
Created: Fri Jan 13 22:30:47 CET 2012
Updated: Fri Oct 26 04:47:19 CEST 2012
JIRA Link: https://rometools.jira.com/browse/FETCHER-1
=========================================

Trying to read this feed:

http://pmq.com/news/rss.php

Here is an example of it:

<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0">
<channel>
<title>PMQ News Room</title>
<description>All the hottest pizza news.</description>
<link>http://pmq.com/news</link>
<language>en-us</language>
<pubDate>Fri, 13 Jan 2012 12:50:56 EST</pubDate>
<item>
<link>http://pmq.com/news/news.php?id=15463</link>
<guid isPermaLink="true">http://pmq.com/news/news.php?id=15463</guid>

The pubdate is in CDATA and when I look at it in rome it is null. So it isn't handled correctly, the title and description are being handled correctly in this case.

mishako commented 8 years ago

Comment by PatrickGotthard Monday Sep 30, 2013 at 15:37 GMT

=== This comment was migrated from JIRA ===
Author: gmkoliver
Created: Fri Oct 26 04:47:19 CEST 2012
===========================================

I'm running into a similar issue where it seems like pubdates of the form <pubDate>Fri, 26 Oct 2012 01:47:20 UTC</pubDate> are not parsed. Here is an entire example item,

<item>
<title>Codebase Downloads w/ Pfile/Passwords</title>
<link>http://www.mudbytes.net/index.php?a=topic&t=4011&p=63177#p63177</link>
<description>[quote=url=/topic-4011-63131#p63131KaVir/url]And while we're on the subject of submissions, I'd still like some way to remove url=http://www.mudbytes.net/topic-3547or at least mark/url iobsolete/i code. It's irritating having to explain to people that despite its name, "KaVir's MUD Protocol Handler (Fixed Up Source Code)" is actually obsolete, and that they should instead download "KaVir's MUD Protocol Handler"./quoteThere doesn't appear to be an option to delete files, but if</description>
<guid isPermaLink="true">http://www.mudbytes.net/index.php?a=topic&t=4011&p=63177#p63177</guid>
<pubDate>Fri, 26 Oct 2012 01:47:20 UTC</pubDate>
<category>General Chatter</category>
<author>nobody@example.com (Scandum)</author>
</item>

Which is from this feed, http://www.mudbytes.net/index.php?a=rssfeed

All dates in the parsed feed are nil. Anyone have a clue about this?

mishako commented 8 years ago

Comment by MrBob007 Tuesday Mar 11, 2014 at 08:31 GMT

I'm also running into a similar issue, when trying to read a feed with pubDate of the form

Tue, 11 Mar 2014 09:18:54. Here is an antire example: Cameroun:Sévérin TCHOUNKEU «Nous mettons sous tabloïd cette œuvre de « 33 » degrés afin que la vérité soit » http://www.camer.be/32364/11:1/cameroun-severin-tchounkeu-nous-mettons-sous-tabloid-cette-uvre-de-33-degres-afin-que-la-verite-soit--cameroon.html <p><img alt="Andre Siaka:Camer.be" src="/UserFiles/image/Andre_Siaka110214300.jpg" style="height:100px; opacity:0.9; width:100px" title="Cameroun:Sévérin TCHOUNKEU «Nous mettons sous tabloïd cette œuvre de « 33 » degrés afin que la vérité soit »" />Dans la boue où baignent désormais nombre de nos concitoyens, il est des exceptions qu’il convient de relever pour leur abnégation au travail bien fait et leur attachement à une certaine éthique du management : André Siaka fait incontestablement partie de ces exceptions-là ! Qui donc mieux que ses employeurs pour le dire ? Qui donc mieux que ceux-là qui l’ont côtoyé pendant plus d’un quart de siècle pour en témoigner ? Il nous a paru nécessaire de mettre à la portée de tous, ces écrits que </p> Tue, 11 Mar 2014 09:04:08 The feed comme from http://camer.be/rss.php

mishako commented 8 years ago

Comment by mishako Thursday Dec 10, 2015 at 21:17 GMT

Let's not mix up different date/time formats.

In the original ticket submitted by Jeffrey publish date is represented as yyyy-MM-dd HH:mm:ss. It doesn't match any existing format, so we shouldn't support it.
Patrick's example has EEE, dd MMM yyyy HH:mm:ss z with UTC time zone. It has been fixed in https://github.com/rometools/rome/pull/212.
Bob tries to parse feed with EEE, dd MMM yyyy HH:mm:ss, i.e. RFC 822 without a zone. It's not correct.

Looks like we can close this issue.

mishako commented 8 years ago

Comment by mishako Tuesday Dec 22, 2015 at 15:43 GMT

Closing this. Please speak up if you don't agree.

rometools / rome

[fetcher] Rome doesn't seem to parse the pubDate correctly out of the RSS feed when it is CDATA #224