Closed LawyZheng closed 2 months ago
Re-enabled iframe handling in the scraping process by adding a scrape_exclude callback to filter specific iframes during scraping.
scrape_exclude
Key points:
skyvern/forge/agent.py
_scrape_with_type
scrape_website
skyvern/forge/app.py
skyvern/webeye/scraper/scraper.py
scrape_web_unsafe
get_interactable_element_tree
get_interactable_element_tree_in_frame
Generated with :heart: by ellipsis.dev
Summary:
Re-enabled iframe handling in the scraping process by adding a
scrape_exclude
callback to filter specific iframes during scraping.Key points:
skyvern/forge/agent.py
: Updated_scrape_with_type
to passscrape_exclude
toscrape_website
.skyvern/forge/app.py
: Addedscrape_exclude
callback definition.skyvern/webeye/scraper/scraper.py
: Modifiedscrape_website
,scrape_web_unsafe
,get_interactable_element_tree
, andget_interactable_element_tree_in_frame
to handlescrape_exclude
callback for filtering iframes.Generated with :heart: by ellipsis.dev