Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
[X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
[X] Please do not modify this template :) and fill in all the required fields.
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I found from Crawl4AI who states that they outperforms Firecrawl significantly:
Simple crawl: Crawl4AI is over 4 times faster than Firecrawl.
With JavaScript execution: Even when executing JavaScript to load more content (doubling the number of images found), Crawl4AI is still faster than Firecrawl's simple crawl.
I would suggest to add this tool to dify to allow different ways to crawl the data from websites.
2. Additional context or comments
No response
3. Can you help us with this feature?
[ ] I am interested in contributing to this feature.
Self Checks
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I found from Crawl4AI who states that they outperforms Firecrawl significantly:
Simple crawl: Crawl4AI is over 4 times faster than Firecrawl. With JavaScript execution: Even when executing JavaScript to load more content (doubling the number of images found), Crawl4AI is still faster than Firecrawl's simple crawl.
I would suggest to add this tool to dify to allow different ways to crawl the data from websites.
2. Additional context or comments
No response
3. Can you help us with this feature?