The open-source repository mev.fyi aggregates research on Maximal Extractable Value (MEV). Explore curated academic papers, community contributions, and educational content on MEV and related topics.
MIT License
62
stars
4
forks
source link
[feature] automatically scrap the referenced websites to fetch the latest published articles #11
Right now we manually add articles from websites. We can add a functionality to crawl all referenced websites and get the latest articles without manually adding them.
Conversely, we can create 'website' i.e. obtain the base domain from all handpicked articles.
We can implement the same curation system as for YouTube video processing
Right now we manually add articles from websites. We can add a functionality to crawl all referenced websites and get the latest articles without manually adding them.
Conversely, we can create 'website' i.e. obtain the base domain from all handpicked articles.
We can implement the same curation system as for YouTube video processing