unclecode / crawl4ai

🔥🕷️ Crawl4AI: Open-source LLM Friendly Web Crawler & Scrapper
Apache License 2.0
16.38k stars 1.2k forks source link

NotImplementedError in asyncio.create_subprocess_exec on Windows #282

Open KaifAhmad1 opened 1 day ago

KaifAhmad1 commented 1 day ago

Issues with crawl4ai Library

1. NotImplementedError in asyncio.create_subprocess_exec on Windows

Description

The crawl4ai library uses asyncio.create_subprocess_exec to start the Playwright browser, which is not supported on Windows. This results in a NotImplementedError, preventing the AsyncWebCrawler from functioning correctly on Windows platforms.

Steps to Reproduce

  1. Run the code on a Windows platform.
  2. Use the AsyncWebCrawler to crawl a URL.
  3. Observe the NotImplementedError when starting the Playwright browser.

Expected Behavior

The AsyncWebCrawler should start the Playwright browser and crawl the URL without raising a NotImplementedError.

Actual Behavior

The code raises a NotImplementedError when attempting to start the Playwright browser using asyncio.create_subprocess_exec.