search

dglazkov / polymath

MIT License
133 stars 9 forks source link

Adding Sitemap importer. #90

Closed PaulKinlan closed 1 year ago

PaulKinlan commented 1 year ago

Point the importer to a sitemap and it will use HTMLScraper importer to fetch all the pages in a site.

dalmaer commented 1 year ago

Nice, wanna add it to the README and then we can pull it in?

PaulKinlan commented 1 year ago

Yeah - happy to, I didn't see one for the HTML importer so I decided to not expose it... just need 5 mins

dalmaer commented 1 year ago

Oh! Mind adding them both? lol