softinio / scalanews

Scala News - A Community Crowd Sourced newsletter using RSS
https://www.scalanews.net
Apache License 2.0
38 stars 13 forks source link

Add ability to scrape links from other sites to include in next edition #3

Open softinio opened 1 year ago

softinio commented 1 year ago

Be nice to scape other sites for latest scala content to include in newsletter

SethTisue commented 1 year ago

not sure whether to open a separate ticket on this or whether this umbrella ticket covers it, but an especially good page to scrape would be https://scala-lang.org/events/ , so then individual PRs such as https://github.com/softinio/scalanews/pull/13 wouldn't be necessary

actually it would probably be easier to pull data from https://github.com/scala/scala-lang/tree/main/_events rather than scraping the rendered web page