Idea: saving hyperlinks within articles as possible related articles

[larryhudson]

• There are often hyperlinks to related articles within the article content
• These are sometimes annoying to hear in the audio output, but could be a useful feature to show "do you want to add these related articles to the queue too?"

How we would implement this

• add a database table called "related links". columns would be title, URL, related article ID (which links to the articles table)
• when we're doing the text-to-speech conversion, when we get the HTML content, get hyperlinks from the content before converting to text
• for each URL, get the 'title' from the URL - might be an npm library to help with this?
• save them to the related links table
• make a new view in the Astro web app for each article at src/pages/article/[id]/index.astro. That should show info about the article including the links of related links
• Make it possible to delete / dismiss related links or easily add them to your queue.

[larryhudson]

I've almost got this working! This morning I:

• created the "related links" table
• adjusted the article extraction code so that it picks up related links in the content. It gets the title from the URL and also saves the context of when it is mentioned in the quote
• adjusted the article creation code so that I can call it from '/related-links/[id]' without needing to do a POST to '/articles/'. Moving code to the src/utils/create-article file has cleaned up the /src/pages/articles/index.astro` code considerably
• change the 'extractTextFromUrl' task to optionally add related links etc.

Still to do:

• need a button for refetching related links
• need to add something to say "this article was a related link on this article". could do a look up of related articles where own_article_id = this article id, then get the article id from there.

[larryhudson]

I'm happy enough with this for now. Fetching the related article titles is pretty slow at the moment but it seems like it's working ok.