+ news feed

[bbest]

• [x] searches:

  • "Humboldt" AND ("offshore wind" )
  • "Morro Bay" AND ("offshore wind" )
  • "Morro Bay" AND ("offshore wind" )

• See News — Offshore Wind California

newsapi (formerly GoogleNews API)

• Pricing - News API: free 200 requests / day; 1 hr late
• Chapter 8 Google News API | 2021_apis_for_social_scientists_a_collaborative_review.knit
• Get news from newsapi using R language - GeeksforGeeks
• SauravKanchan/NewsAPI: News API without any API KEY
• mkearney/newsAPI: API wrapper/R client for accessing https://newsapi.org

[bbest]

Local news sources (and RSS feeds)

Santa Barbara

• Top 10 Santa Barbara News RSS Feeds (City in California)
• Edhat | Local News From Your Community (rss.xml)
• Noozhawk.com (RSS feeds)

TODO: San Luis Obisbo (for Morro Bay)

Humboldt County

• Lost Coast Outpost (RSS)

Priority feeds / example news items:

• Lost Coast Outpost: Offshore Wind is Coming to the North Coast. What's in it For Humboldt?
• HA Foundation: News & Events | New Redwood CORE Hub Proposes Ambitious ‘Carbon N
  • RedwoodCOREHub: Redwood Region Climate and Community Resilience (CORE) Hub
• Humboldt Baykeeper
  • Humboldt Baykeeper: BOEM seeks feedback on proposed offshore wind lease conditions
  • CA Energy Commission: State Approves $10.5 Million to Prepare the Port of Humboldt Bay for Offshore Wind
  • Times-Standard: Fishermen join forces amid Humboldt County offshore wind development
  • BOEM - California Activities

[bbest]

software

newsapi in Py

• • GoogleNews API—Live News from Google News using Python | by Mansi Dhingra | Analytics Vidhya | Medium
• GoogleNews · PyPI

rss handling in R

• tidyRSS | An R package for extracting ‘tidy’ data frames from RSS, Atom, JSON and geoRSS feeds
• feedeR: Reading RSS and Atom Feeds from R | R-bloggers
• RSS, fantastic tool for keeping up-to-date | R-bloggers

[bbest]

From @jzadra : the news package from Matt Tierney is ~6 yrs old, so prob want to go a diff't direction

[bbest]

For raw API parsing, check out:

• Wrapping APIs • httr2
• Perform multiple requests in parallel — multi_req_perform • httr2

[bbest]

Hi @jzadra,

Check out this little example of using the free version (100 requests per day, search articles up to a month old) of the newsapi.org API (see docs) using R package httr2:

• source: cstories-app/scripts: news-api.qmd
• rendered html: cstories.app/scripts/news-api.html

Next steps could be:

• [x] wrapping in a little function
• [x] performing searches specific to places, like "Humboldt", "Morro Bay" and "Santa Barbara"
• [x] expanding searches to a month back
• [x] organizing content in data folder with naming convention for json files
• [ ] ...

[jzadra]

Another R Package for newsapi.org: https://cran.r-project.org/web/packages/newsanchor/vignettes/usage-newsanchor.html

I have not investigated thoroughly; probably created our own API requests is more customizable.

[jzadra]

News API

Function features:

• [x] Save data pulls to keep results > 1 month old (if staying on free newsapi.org plan)
• [x] Read search terms from simple, separate file
• [x] Format results for news feed
• [x] Append search terms to results table for user-filtering

Decisions to be made:

• [ ] Sort API search results by relevancy, popularity, or published date?

[bbest]

@geocoug's suggestion of each news item to have it's own *.qmd doc is a good one. The metadata can be populated into the frontmatter yaml and then a listing created per here:

https://quarto.org/docs/websites/website-listings.html

[jzadra]

Newsapi.org results are listed on the index page (currently most recent 3), and there is a News page with all results.

Next items to do:

• [ ] Add filter based on search terms
• [ ] Determine method to handle non-relevant results and/or refine search terms
• [ ] Automate running of API script and qmd generation
• [ ] Make "Read full article" link open new tab
• [ ] Add "back" button
• [ ] filter out transcripts (ie npr)

[jzadra]

The following RSS feeds suggested above either do not have rss feeds, or link to empty xml documents:

Local news sources (and RSS feeds)

Santa Barbara

• Edhat | Local News From Your Community (rss.xml) (see https://validator.w3.org/feed/check.cgi?url=https%3A%2F%2Fwww.edhat.com%2Frss.xml)

TODO: San Luis Obisbo (for Morro Bay)

Priority feeds / example news items:

• HA Foundation: News & Events | New Redwood CORE Hub Proposes Ambitious ‘Carbon N
  • CA Energy Commission: State Approves $10.5 Million to Prepare the Port of Humboldt Bay for Offshore Wind

[jzadra]

The issue with the news item below is not clear. It appears to break at the $, however there are 15 other news items that have $ in the title and do not have an issue.

[jzadra]

It appears that this issue is due to it trying to render it as a mathjax equation. I am still at a loss as to why. @bbest any ideas?

[jzadra]

Ok, I have further eliminated some possible causes - it turns out that the offending item "Landmark California"... is not the issue. If it is removed, a different item has the same issue:

Original issue

Same issue, different item once first item is removed: