clemlesne / scrape-it-now

Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
Apache License 2.0
492 stars 16 forks source link

Add more columns to the AI Search index #30

Closed clemlesne closed 1 month ago

clemlesne commented 1 month ago

Ideas:

clemlesne commented 1 month ago

New is published: 0b5c2c630c2866c1f1b183a5af9d0fbb454a1246.