mendableai / firecrawl

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
https://firecrawl.dev
GNU Affero General Public License v3.0
17.17k stars 1.24k forks source link

Make /map check for base url sitemap as well #688

Open nickscamara opened 3 weeks ago

rohitt-gupta commented 1 week ago

Hey can you give more details on this? i would love to take on this one?