This pull request includes a change to the crawl4ai/async_webcrawler.py file, specifically modifying the aprocess_html function to use the pop method for extracting keyword arguments instead of the get method.
Codebase simplification:
crawl4ai/async_webcrawler.py: Changed the aprocess_html function to use kwargs.pop instead of kwargs.get for only_text and image_description_min_word_threshold. This ensures that these keyword arguments are removed from kwargs after being accessed to prevent pass duplicated kwargs to scrapping_strategy.
This pull request includes a change to the
crawl4ai/async_webcrawler.py
file, specifically modifying theaprocess_html
function to use thepop
method for extracting keyword arguments instead of theget
method.Codebase simplification:
crawl4ai/async_webcrawler.py
: Changed theaprocess_html
function to usekwargs.pop
instead ofkwargs.get
foronly_text
andimage_description_min_word_threshold
. This ensures that these keyword arguments are removed fromkwargs
after being accessed to prevent pass duplicated kwargs to scrapping_strategy.