RSS feeds

[dnoesgaard]

This is just a reminder to enable RSS feeds at some point.

I'm not sure how they are currently generated, but it would be great if we had feeds for news, data uses, events, and perhaps a feed combining all of them.

To be able to better track traffic generated from RSS readers, it would be great if the links in feeds could include UTM paramaters for Google Analytics.

[MortenHofft]

I believe these are all driven of ES now and Fede have already implemented them. But they aren't on prod yet it seems? See https://github.com/gbif/portal16/issues/466

[MortenHofft]

The rss feeds are in place but not yet added to news and datause.

[dnoesgaard]

Could we have an official note of the actual endpoints of all the feeds available? I can make a lot of educated guesses, but it would nice to have on record. Thanks!

[dnoesgaard]

Reopening this because the news and datause feeds don't contain correct links to posts, e.g.

<item>
      <title>Top tip: The GBIF network: country by country, region by region</title>
      <description>The GBIF node community is the heart and soul of GBIF's activities at national, regional and global scales, and the new [GBIF network](/the-gbif-network) page provides a fresh take on navigating essential details about our Participant countries and organizations, as well as non-member countries. 

The map clearly focuses on GBIF's national members. Click on any of the coloured countries, and you'll get a quick abstract showing the main national contacts and counts of its endorsed data publishers, occurrence datasets and records. But selecting a greyed-out, non-member country will also highlight any available data resources.

Below the map, you'll find contact information for the elected representatives of the global nodes community and a complete list of all GBIF Participants (sortable by any column). But for member and non-member nations alike, the map on the network page now provides the most direct path to the detailed information pages we maintain for all of the world's countries, islands and territories (some tips on those will follow later this week). Just follow the links embedded in the country names at the top of any pop-up summary.

The network page also provides quick access to GBIF's six regional networks, and the tabs above the map show the way. [Africa](/the-gbif-network/africa), [Asia](/the-gbif-network/asia), [Europe](/the-gbif-network/europe), [Latin America](/the-gbif-network/latin-america), [North America](/the-gbif-network/north-america) and [Oceania](/the-gbif-network/oceania)—click your pick, and the map will zooms to display the region. The rest of the page refreshes as well, displaying contact information for the region's node representatives and a Participant list refreshes to show the region's members. 

Even in this simple presentation, the addition of this regional view fulfills a long-standing request from the nodes community to represent their largely self-organized and self-organizing activities. We're eager to hear suggestions on how to build on this view and display additional information consistently across all regional pages. As with all feedback, just click the chatbox in the upper right of every page.</description>
      <pubDate>Tue, 29 Aug 2017 12:01:16 GMT</pubDate>
      <dc:date>2017-08-29T12:01:16Z</dc:date>
    </item>

RSS feeds are also usually HTML, but I realize that might be tricky.

[thomasstjerne]

It is now deployed to dev: https://www.gbif-dev.org/resource/search?contentType=news https://www.gbif-dev.org/resource/search?contentType=dataUse

The RSS links are XML

[dnoesgaard]

It seems that the XML still don't have a proper link to the actual content item they represent?

Take the first item in https://api.gbif-dev.org/v1/newsroom/news/rss, for example. It contains no links, but should link to https://www.gbif-dev.org/news/3OjHxpWdlKQ0cAWeuMgCek/top-tip-sorting-out-top-species-in-search-results

My comment about HTML was imprecise. Of course the RSS feeds are XML, however, usually the text contained in the main body, i.e. "description" is HTML or plain-text.

[dnoesgaard]

Here's another example comparing the old Drupal-generated to the new one:

OLD:

      <item>
    <title>iDigBio joins GBIF as organizational member</title>
    <link>http://www-old.gbif.org/news/83368/idigbio-joins-gbif-as-organizational-member</link>
    <description> &lt;div&gt;&lt;a href=&quot;https://www.idigbio.org/&quot;&gt;iDigBio&lt;/a&gt;, which coordinates projects to digitize natural history collections in the United States with funding from the &lt;a href=&quot;http://www.nsf.gov/&quot;&gt;National Science Foundation&lt;/a&gt;, has become the latest non-country Participant in the GBIF network.  &lt;/div&gt;
&lt;div&gt; &lt;/div&gt;
&lt;div&gt;Formally known as Integrated Digitized Biocollections and based at the &lt;a href=&quot;https://www.floridamuseum.ufl.edu/&quot;&gt;Florida Museum of Natural History&lt;/a&gt;, iDigBio is a collaboration between the &lt;a href=&quot;http://www.ufl.edu/&quot;&gt;University of Florida&lt;/a&gt; and &lt;a href=&quot;https://www.fsu.edu/&quot;&gt;Florida State University&lt;/a&gt; and serves as the central resource for the Advancing Digitization of Biodiversity Collections programme. iDigBio’s efforts make information about biological and paleontological specimens in U.S. research collections freely open and available online, improving research and outreach to scientists, researchers, students, educators and other user communities for the benefit of all sectors of society.&lt;/div&gt;
&lt;div&gt; &lt;/div&gt;
&lt;div&gt;&quot;Enhancing our relationship with GBIF will greatly increase the exposure and information content of biodiversity data”, said Larry Page, Director of iDigBio. “We hope that joining GBIF as a Participant will lead to improved environmental research and decisions related to habitat loss, climate change and other factors impacting biodiversity.&quot;&lt;/div&gt;
&lt;div&gt; &lt;/div&gt;
&lt;div&gt;In addition to promoting uses of collections data by scientific and stakeholder communities, iDigBio also develops and shares digitization standards, workflows and best practices. These efforts rely on iDigBio’s own &lt;a href=&quot;https://www.idigbio.org/content/thematic-collections-networks&quot;&gt;Thematic Collections Networks&lt;/a&gt; to connect U.S.-based institutions to digitize specimens and integrate biocollections resources and tools and support a growing constituency of collections partners worldwide. The ongoing &lt;a href=&quot;https://www.idigbio.org/content/darwin-core-hour-webinar-series&quot;&gt;Darwin Core Hour webinar series&lt;/a&gt;, for instance, provides data publishers everywhere with practical skills and approaches for making biodiversity data more accessible, interoperable and reusable across many research domains.&lt;/div&gt;
&lt;div&gt; &lt;/div&gt;
&lt;div&gt;“iDigBio is important to the GBIF network not just as a national hub for digitizing vouchered natural history collections, but also as a key partner that shares its knowledge resources internationally,” said Donald Hobern, Director of the GBIF Secretariat. “Its emphasis on developing training and standards makes an enormous contribution toward establishing the integrated, interconnected data needed to create a virtual natural history collection for the 21st century.&quot; &lt;/div&gt;
 </description>
     <pubDate>July 24th, 2017</pubDate>
 <dc:creator />
 <guid isPermaLink="false" />
  </item>

NEW:

 <item>
      <title>iDigBio joins GBIF as organizational member</title>
      <description>[iDigBio](https://www.idigbio.org/), which coordinates projects to digitize natural history collections in the United States with funding from the [National Science Foundation](http://www.nsf.gov/), has become the latest non-country Participant in the GBIF network.  

Formally known as Integrated Digitized Biocollections and based at the [Florida Museum of Natural History](https://www.floridamuseum.ufl.edu/), iDigBio is a collaboration between the [University of Florida](http://www.ufl.edu/) and [Florida State University](https://www.fsu.edu/) and serves as the central resource for the Advancing Digitization of Biodiversity Collections programme. iDigBio’s efforts make information about biological and paleontological specimens in U.S. research collections freely open and available online, improving research and outreach to scientists, researchers, students, educators and other user communities for the benefit of all sectors of society.

"Enhancing our relationship with GBIF will greatly increase the exposure and information content of biodiversity data”, said Larry Page, Director of iDigBio. “We hope that joining GBIF as a Participant will lead to improved environmental research and decisions related to habitat loss, climate change and other factors impacting biodiversity."

In addition to promoting uses of collections data by scientific and stakeholder communities, iDigBio also develops and shares digitization standards, workflows and best practices. These efforts rely on iDigBio’s own [Thematic Collections Networks](https://www.idigbio.org/content/thematic-collections-networks) to connect U.S.-based institutions to digitize specimens and integrate biocollections resources and tools and support a growing constituency of collections partners worldwide. The ongoing [Darwin Core Hour webinar series](https://www.idigbio.org/content/darwin-core-hour-webinar-series), for instance, provides data publishers everywhere with practical skills and approaches for making biodiversity data more accessible, interoperable and reusable across many research domains.

“iDigBio is important to the GBIF network not just as a national hub for digitizing vouchered natural history collections, but also as a key partner that shares its knowledge resources internationally,” said Donald Hobern, Director of the GBIF Secretariat. “Its emphasis on developing training and standards makes an enormous contribution toward establishing the integrated, interconnected data needed to create a virtual natural history collection for the 21st century."</description>
      <pubDate>Mon, 24 Jul 2017 14:37:41 GMT</pubDate>
      <dc:date>2017-07-24T14:37:41Z</dc:date>
    </item>

Notice that the link to the post is missing.

[thomasstjerne]

@fmendezh could you take a look on this?

[kcopas]

Note the disappearance of this line, too:

http://www-old.gbif.org/news/83368/idigbio-joins-gbif-as-organizational-member

My RSS feed reader is sending me to the first link in the text, which is definitely not the intent—we want them to go to the link for the news/event/whatever.

[dnoesgaard]

Was just reminded about this one while going through my own RSS feeds:

The gbif.org RSS feeds still don't contain links to the individual posts, effectively making them useless.

[dnoesgaard]

/v1/newsroom/news/rss looks good for most parts, the most recent entries at least. There are still a few odd ones, e.g.

 <title>Fernandes becomes second consecutive Brazilian to win GBIF Young Researchers Award</title>
      <link>https://www.gbif.org/dataset/914c3b86-f2a1-4d5e-b343-b2597b9d4542</link>
...
 <title>Escribano becomes first Spaniard to win GBIF Young Researchers Award</title>
      <link>https://www.gbif.org/dataset/dfddad59-5bc5-4e35-8b35-334eed43bba9</link>
...
<title>Job opportunities for software developers</title>
      <link>https://assets.contentful.com/uo17ejk9rkwj/6TXmNMw8KIAky8I6as4ueU/ad0215afb68a34be7590f0b40ec51419/Advert_for_GBIF_Software_Developer_2_-_2017.pdf</link>

It seems that items with primaryLink uses this instead of the link to the news item? To be clear, rss feed items should always link to the news items themselves, not any links inside the news items.

The same appears to be the case for /v1/newsroom/uses/rss, only the use of primaryLink here is much more frequent and thus they are all linked to the original papers, not the dataUse items.

[dnoesgaard]

Every time I post a new data use story on gbif.org, I'm reminded that the RSS feed doesn't link correctly to the post, but rather to whatever primarylink is in that post, e.g.

<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:dc="http://purl.org/dc/elements/1.1/" version="2.0">
  <channel>
    <title>GBIF news feed</title>
    <link>http://www.gbif.org/newsroom/news/rss</link>
    <description>GBIF News</description>
    <language>en</language>
    <dc:language>en</dc:language>
    <item>
      <title>Port Stephens, Australia - a sea hare haven?</title>
      <link>https://doi.org/10.1080/13235818.2016.1207280</link>   <----- SHOULD be link to post on gbif.org 
      <description>&lt;p&gt;Sea hares are &lt;a href="https://www.gbif.org/species/121305684"&gt;heterobranch&lt;/a&gt; sea slugs of the &lt;a href="https://www.gbif.org/species/6814"&gt;Aplysiidae&lt;/a&gt; family with large ear-like rhinophores, responsible for the vernacular of the group. Members of this globally distributed family usually only live up to one year, while producing up to 180 million eggs, and in some species growing to a size of up to two kilograms.&lt;/p&gt;
&lt;p&gt;In a recent study, researchers investigated and documented the diversity of aplysiid diversity in Port Stephens, NSW, Australia, home to more species than anywhere else in the world. With the most diverse algal flora in the world, the waters of southern Australia provide the ideal living conditions for sea hares whose diets consists of marine plants- mostly algae.&lt;/p&gt;
&lt;p&gt;While reviewing the taxomomy and nomenclature of the group, the authors describe the morphology and distributions of 16 species found in the region, including the first observation of &lt;a href="https://www.gbif.org/species/2297327"&gt;&lt;em&gt;Petalifera&lt;/em&gt; sp.&lt;/a&gt; in Australian waters. Highlighting the global significance of Port Stephens for Aplysiidae and an obvious target for further sea hare studies, this study forms a baseline for detecting changes to aplysiid diversity in future, changing climates.&lt;/p&gt;</description>
      <pubDate>Fri, 04 May 2018 09:01:11 GMT</pubDate>
      <guid>https://doi.org/10.1080/13235818.2016.1207280</guid>
      <dc:date>2018-05-04T09:01:11Z</dc:date>
    </item>

Could we pls fix this?

[dnoesgaard]

Hi guys.

I've just noticed that Altmetric pulls our RSS feed for data use as mentions of paper. Because our links are wrong, people are taken directly to the paper and NOT to our website, for example:

https://www.altmetric.com/details/18186157/blogs

"Climate change - a double-edged sword for invasive species?" is the title of my post, but if you click the link, you're taken to the paper landing page.

Pretty PLEASE with sugar on top - can we fix this?

[MortenHofft]

https://github.com/gbif/content-ws/blob/master/src/main/java/org/gbif/content/utils/ConversionUtil.java#L53

entry.setLink(getNestedField(source, "primaryLink", "url", locale)
                    .orElseGet(() -> altBaseLink + '/' + searchHit.id()));

I'm guessing this should simply set the link to altBaseLink + '/' + searchHit.id()) and ignore the first line. For Data use and news we want to link to our own pages. For events it is acceptable to link to our own instead of the primaryLink (external event pages).

The only place where doing this would be odd is id we added RSS feed to tools, and even then it would still work ok. As far as I can see.

@thomasstjerne and @fmendezh you might see something I haven't? Else I suggest:

entry.setLink(altBaseLink + '/' + searchHit.id()); //assuming altBaseLink is the urls we use aka tool/datause/news etc

[dnoesgaard]

As a work-around for this, I'm currently avoiding using primaryLink in data use items...

[fmendezh]

All rss feeds and calendar cars (vCards) point to the GBIF event or news