search

mendableai / firecrawl

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
https://firecrawl.dev
GNU Affero General Public License v3.0
15.29k stars 1.11k forks source link

[Bug] Scraping: `excludeTags` is ignored when `includeTags` is given. #700

Open wottpal opened 1 week ago

wottpal commented 1 week ago

Describe the Bug When I'm scraping I can't make excludeTags (neither in html or markdown formats). I assume it's because I need includeTags and only one parameter (includeTags xor excludeTags) is supposed to be working. – Is that correct?

I constantly have the use case that I want to include something but exclude certain child tags. Is that use case supported?

mogery commented 1 week ago

Hi there, both parameters combine should work too, I'll look into this.