search

darrenwatt / xml-to-discord-post

Keyword searches for things on BBC News xml feeds, posts on Discord and/or Twitter. The secret backend of @deathbot4000
https://x.com/deathbot4000
0 stars 0 forks source link

Duplicates in feed #4

Open darrenwatt opened 8 months ago

darrenwatt commented 8 months ago

BBC have started putting hashes into the feed, so we probably want to strip any nonsense out of the URL. eg. yesterday: https://www.bbc.co.uk/news/entertainment-arts-68433779 today: https://www.bbc.co.uk/news/entertainment-arts-68433779#0 and https://www.bbc.co.uk/news/entertainment-arts-68433779#1

darrenwatt commented 8 months ago

0d0a2b35ef2be4c1da05f5cd97d1773d541f1487, to be tested