search

ahmedbesbes / media-agent

Scrape data from social media and chat with it using Langchain
129 stars 18 forks source link

Scrape external links posted in Reddit #6

Open syltruong opened 1 year ago

syltruong commented 1 year ago

In Reddit, many submissions will relay news from other traditional media and include links to those.

These are the places where the most information lies. It would be great to be able to embed that information.

ahmedbesbes commented 1 year ago

I think the first thing to do would be to extract the answers of each Reddit submission since they contain a lot of relevant information to the post.

syltruong commented 1 year ago

Yes indeed, it is totally feasible. This is the reference for navigating the comments of a post.

I can suggest to pick this task up this weekend

ahmedbesbes commented 1 year ago

It'd be great, thank you!