clemlesne / scrape-it-now

Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
Apache License 2.0
491 stars 16 forks source link