search

unclecode / crawl4ai

🔥🕷️ Crawl4AI: Crawl Smarter, Faster, Freely. For AI.
https://crawl4ai.com
Apache License 2.0
17k stars 1.26k forks source link

Failed to take a screenshot. The screenshot is blank. #167

Closed ns-arakawa closed 1 month ago

ns-arakawa commented 1 month ago

I found a problem with v0.3.6 where the screenshot would be blank. This problem seems to occur on sites that are reloaded using javascript like "https://0-0.energy"

I got around this by changing the source in async_crawler_strategy.py. I attached screenshot of souce code I changed

スクリーンショット 2024-10-14 180406

I changed the value of the argumen for page.wait_for_timeout from 100 to 3000. I think that the appropriate value will differ depending on the site. It is better to change to changrable parameter from API.

unclecode commented 1 month ago

@ns-arakawa Thx for pointing this out, I am checking it right now

unclecode commented 1 month ago

@ns-arakawa I tested with the give URL, I can't replicate your case unfortunately, on my end it works. Can you share your exact code? Thx

ns-arakawa commented 1 month ago

This case was caused by Javascript in Goddy's parked domain. This was not a crawl4ai bug. I will close this ticket

unclecode commented 1 month ago

Thx